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Abstract 

Four lemmas, which constitute the theoretical foundation necessary to determine optimal control strategies 
for a class of single machine family scheduling problems, are presented in this technical report. The scheduling 
problem is characterized by the presence of sequence-dependent batch setup and controllable processing times; 
moreover, the generalized due-date model is adopted in the problem. The lemmas are employed within a con¬ 
structive procedure (proposed by the Author and based on the application of dynamic programming) that allows 
determining the decisions which optimally solve the scheduling problem as functions of the system state. Two 
complete examples of single machine family scheduling problem are included in the technical report with the aim 
of illustrating the application of the fundamental lemmas in the proposed approach. 
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1 Introduction 

In ID, a class of single machine family scheduling problems (mainly characterized by multiclass jobs, generalized 
due-dates, and controllable processing times) has been formalized as an optimal control problem. Its solution 
consists of optimal control strategies which are functions of the system state, and therefore they are able to provide 
the optimal decisions for any actual machine behavior (the single machine is assumed to be unreliable and then 
perturbations, such as breakdowns, generic unavailabilities, and slowdowns, may affect the nominal behavior of 
the system). However, the scheduling problem in m has been solved under the assumption that, for each class of 
jobs, any unitary tardiness cost is greater than the unitary cost related to the deviation from the nominal service 
time. In order to remove such a strong hypothesis and to extend the scheduling model by adding setup times and, 
especially, setup costs, new fundamental lemmas have been defined. They are employed within the constructive 
procedure proposed in ||2l that solves, from a control-theoretic perspective, a single machine scheduling problem 
with sequence-dependent batch setup and controllable processing times. 

This technical report is organized as follows. Some preliminary definitions are reported in section |2] The four 
new lemmas are presented in sections [3 together with their complete proofs. Nine numerical examples aiming at 
illustrating how lemmas [D and |2] work are in section |4] Finally, sections |5] and | 6 ] present two complete example 
which explain the application of the procedure proposed in 131 to two single machine family scheduling problems 
(the latter with setup). 


2 Definitions 

Definition 1. Consider a function f{x) which is continuous, nondecreasing, and piece-wise linear function of the 
independent variable x. Let f{x) be characterized by M >1 changes of slopes and let ji, i = 1,..., M, be the 
values of the horizontal axis at which the slope changes ( 7 i+i > 7 i, Vj = 1,..., M — 1). In this connection, let 
po be the slope in interval (— oo, 71 ), be the slope in interval [ 7 ^, 7 ^+ 1 ), i = 1,..., M — 1, and jiM be the slope 
in interval [ 7 ^, + 00 ) (yti+i Vi = 0,..., M — 1). Moreover, it is assumed f{x) = 0 for any a; < 71 ; then, 

/io = 0. An example of function f{x) following this definition is in figure[D 



Definition 2. With reference to f{x), as defined by definition[D let f{x -F f) be a continuous, nondecreasing, and 
piece-wise linear function of the independent variable x, parameterized by the real value t. An example of function 
f{x + t) following this definition is in hgure |3 
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Figure 2: Example of function f{x + t). 


Definition 3. Consider a function g{x) which is noncontinuous, nonincreasing, and piece-wise linear function of 
the independent variable x. Let g{x) be defined as 

sw = I (1) 

\ 0 X i [Xl,X2) 

An example of function g{x) following this definition is in figured 



Figure 3: Example of function g{x). 


3 Lemmas 

In connection with functions f{x) and g{x) as defined by definitions [T] and [2 let; 

• A be the set of indices i, i G { 1 ,..., M}, such that gi-i < v and > v\ in this connection, let |A| be 
the cardinality of set A and, if |A| > 0, let aj, j = 1,..., |A|, be the generic element of set A; thus, 7 ^^, 
j = 1 ,..., |A|, are the value of the horizontal axis at which the slope of f{x) changes from a value less than 
V io value greater than or equal to v, 

• be the set of indices i, i G {1,..., M}, such that gt-i > v and gi < v\ in this connection, let \B\ be 
the cardinality of set B and, if |i3| > 0 let 6 j, j = 1,..., |i?|, be the generic element of set B; thus, 7 b , 
j = 1 ,..., |i?|, are the value of the horizontal axis at which the slope of f{x) changes from a value greater 
than or equal to to a value less than v. 

Since it has been assumed = 0, then aj < bjW j = 1,..., \B\ and bj < aj+i V j = 1,..., |A| — 1. Moreover, 

1^1 — |S| < 1 being |A| = \B\ if pM < v and |A| = \B\ + 1 if > v- 
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Lemma 1. Let f{x + i) be a continuous nondecreasing piece-wise linear function of x, parameterized by t, as 
defined by definition|2] and let g{x) be a noncontinuous function of x, as defined by definition|3] 

In case \B\ > 1, let 17 be the set of time instants {wi ,... ,ujj,..., W|b|} in which any value ujj, j = 1,..., \B\, is 
obtained by executing algorithm [T] Each value ujj, j = 1,..., |-B|, is either finite or nonfinite. Let T be the set of 
time instants , f*,..., fg} which is obtained from fl by removing all nonfinite values from it, that is 

T = fl\{u}j : Wj = -Fcx) , j = 1,... ,\B\} (2) 

Let Q be the cardinality of set T; it is obviously 1 < Q < |_B|. In case |i?| = 0, it is T = 0 and Q = 0. 

Then, the function of t 

x°{t) = arg mm [f {x + t) + g{x)) (3) 

X\KxKx2 

is a nonincreasing, possibly noncontinuous, piece-wise linear function of t defined as 


if g = 0 : 

X°{t) = Xe{t) 


(4a) 

ifg = 1 : 

X°(t) = j 

Xs(f) 

, Xe{t) 

IV A 

(4b) 



{ Xsit) 

t < t\ 


if g > 1 : 

x°{t) = 

Xq{t) 

</</*+!, g = i,...,g-i 

(4c) 


1 

[ Xeit) 

t>t*Q 



where Xs{t), Xq{t), and Xe(f) are the following functions of t: 

• Xs{t) is a continuous nonincreasing piece-wise linear functions of t defined as: 





( X2 

t <^ai - X2 


iftl 

> 7ai - 2:1 

11 

1 + 7ai 

lai - X2 <t < 7ai - Xl 

(5a) 




[ Xl 

lai - Xl <t < t\ 


iftl 

T 

H 

1 

VI 

II 

X2 

, -f + 7ai 

/ < 7ai - 2:2 

lai - X2 <t < 

(5b) 


• Xq{t) is a continuous nonincreasing piece-wise linear functions of t defined as: 


if t*q < + l - ^2 

and > 7a,(,)+i - xi 


X 2 t* <t< - 2:2 

-t + 7 a,(,)+i 7a,(,) + l - X2<t< - Xi (6a) 

Xl 7a,(,) + i - Xi<t< 


if t*q > 7 a,(,) + i - 2:2 


Xq{t) = <j 

f -f + 7 a,(,)+i 

t*q<t< 7 a,(,) + i - 2 l 

and > 7 a,(,)+i - 2:1 


( 2 i 

7 a,(,) + l - 21 < / < f*+i 

if t*q < 7 a,(,) + i - 22 


Xqit) = <j 

f 22 

t*q<t< 7 a,(,) + i - 22 

and < 7 a,(,)+i - 21 


1 -f + 7 a,(,)+i 

7 a,(,) + i -X2<t< 

if t*q > 7 a,(,) + i - 22 
and < 7 a,(,)+i - 21 


Xq(t) = 

-f + 7 ai(,)+i 



(6b) 

(6c) 

(6d) 


if/(Q) < |7l| 

and < 7a,(Q)+i - 2:2 

if/(g) < |7l| 

and t*Q > - X 2 

if 1{Q) = \A\ 

having assumed (for notational c 



1 

r 22 

t*Q<t< 7a,(Q)+i - 22 



Xeit) = < 

1 ~f + 7ai(Q)+i 

7oi(Q) + i ~ X2 t < 7ai(Q)+i ~ 2i 

(7a) 



[ 2i 

t — 7oi(Q) + i ~ 2i 



Xeit) = <1 

~t + 7ai(Q)+i 

t*Q<t< 7ai«5) + i - 2l 

(7b) 


. 21 

t — 7ai(Q)+i ~ 2i 

-)• 

Xeit) = X2 


(7c) 


) tg = —00 when g = 0. 
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In (|6]l and O, Z(g), g = 1,..., Q, is a mapping function which provides the index j € {1,..., |_B|} of the value 
t* in the set fl, that is, l{q) = j ^ ojj = t*. In this connection, it is always 1{Q) — \B\ and, in case |A| > 
turns out 1{Q) + 1 = |A|. Moreover, it is assumed, for notational convenience, Z(0) = 0. 


Algorithm 1. Determination of the time instant ujj, j = 1,..., \B\, at which, in case ujj < +oo, the function 
x°{t) jumps in an upward direction. 


SECTION A - INITIALIZATION 
1 
2 


10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 


7o = -oo 

h>D:^h<lbj-{x2- xi) < 7/1+1 

i = bj 

7M+1 = +00 

k< M : 7fe < 7bj + (a:2 - xi) < "fk+i 
if j = \B\ and |A| = \B\ then 
Gj + l = M + 1 

end if 

for p = h to fc do 

fLp= ICp-V 

end for 

T = 7b,. - {X2 - Xi) 

0 = lb, 

d = max{ 0 ,/i/i( 7 / 1+1 - r)} 

ii h < bj — 1 then 

for p = h + 1 to 6 , — 1 do 


d = max{0, d - 

end for 
end if 

X = h 

C = * 


iXpilp+l - Ip)} 


while h < bj and i < Oj+i do 

r/) = min{7/i+i - T,l^+l - 0} 

if 7/1+1 - r < 7i+i - 9 then 
A = h + 1 

end if 

if ih+i - T> 7 i+i - 0 then 

^ = i + l 

end if 

<5 = max{0,/iA[7A+i - (t + tp)]} 

if A < — 1 then 

for p = A + 1 to — 1 do 


S = max{0, S + jlp{ip+i - ip)} 


45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 


r > 1 : Qr-i < h < ar 

it r < j then 

for q = r to j do 

X = Thilh+i - t) 

it h < Qq — 1 then 

X = X + T,l=~h+1 Tpilp+i-Ip) 

end if 

it q — r then 

m = x 

else 

m = min{TO, x} 

end if 
end for 
if TO < 0 then 

UJj = T - Xi - 

else if < 42 - then 

Mi — 

LO, = T — X-l + - - 

7 ^ Ph-Pi 

exit algorithm 
else 

U,^=T-Xl-^ 

exit algorithm 
end if 


else 


LOj = T — Xi 


d 


WO . ww , , 

7 ^ Ph-Pi 

exit algorithm 
end if 


else 

h = X 
i = ^ 

T = T - 
0 = 0 - 
d = 6 

end if 
end while 


■ V' 

• l/> 


SECTION C - SECOND LOOP 


34 

end for 

79 

while h < bj do 

35 

end if 

80 

tp = 7 / 1+1 - T 

36 

if ^ = bj then 

81 

A = h + 1 

37 

S = 6tjj) - 75 ] 

82 

if A < bj then 

38 

else if C = Gy+i then 

83 

6 = max{0 

39 

S = S + Ep=b, Tpilp+I - Ip) 

84 

if A < 6 j — 

40 

else 

85 

for p = 

41 

S = S + EpZl^ Mp(7p+1 - 7p)+ 

86 

(5 = 


+P5[(6I +V') -7?] 

87 

end for 

42 

end if 

88 

end if 

43 

if <5 < 0 then 

89 

else 

44 

Oo = 0 

90 

0 

II 


1 to bi — 1 do 
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91 

end if 

105 

if (/> < 0 then 

92 

= <^ + P-pilp+i - 7p) 

106 

ujj = +00 

93 

if <5 < 0 then 

107 

exit algorithm 

94 

T = T + -f- 
flh 

108 

else 

95 

9 = T + {X2 — Xi) 

109 

r = r + 1 

96 

k < M : Jk <9 < 7fc+i 

110 

end if 

97 

r = aj+i 

111 

end while 

98 

</) = 0 

112 

H 

1 

II 

3 

99 

while r < kdo 

113 

exit algorithm 

100 

ifr<k then 

114 

else 

101 

: (/) = (/) + /ir(7r+l -7r) 

115 

h = X 

102 

else 

116 

T = T + ^1 

103 

: f f + p,^(^9 - Jr) 

117 

d = S 

104 

end if 

118 

end if 



119 

end while 


Proof. The function x°{f) can be obtained by analyzing the shape of the function f{x + f) + g{x) in the interval 
[xi, X 2 ], with t moving from —00 to + 00 . The proof consists of seven parts: 

1. in the first part, it is proven that, when \B\ = 0,x°{t) has the structure provided by (l4al) . with Xe{t) provided 
by (|2il) (if 1{Q) < 1^1) or ([Tell (if 1{Q) = |^|); 

2 . in the second part, it is proven that, when 7 b^ ~'laj > {x 2 —Xi),Vj = l,...,|i3|,|i?| > 0 , and ~lbj > 
{x 2 —xi), M j = 1,... ,\A\ — 1,\A\ > 1, a;°(t) has the structure provided by (l4b]) or (l4cl i. with Xs{t) provided 
by dSal i. Xq{t),q = 1,..., Q — 1, Q > 1. provided by d^ . and Xe{t) provided by (TTal) (if Z((3) < |^|) or (TTcl) 
(if i{Q) = \A\y, 

3. in the third part, it is shown that the number of jump discontinuities in x°(t) may be less than \B\, that is, 
they are Q < \B\, and the conditions for which a jump discontinuity does not exist in connection with a 
specific abscissa 7 f,^. — t, j G { 1 ,..., |i?|} are provided; 

4. in the fourth part, it is proven that, even if the assumptions considered in the second part do not hold for 
some j G {1, • ■ •, |B|} or j G {!,■■■, |^| — 1}, it is sufficient that > jai — xi, or t* < 7ai(,)+i — X 2 
and > 7 a,(,)+i - xi, g e { 1 ,..., Q - 1 }, Q > 1 , or < 7 ^q)+i “ ^ 2 , to guarantee that Xs{t) has 
the structure provided by (l5al i. Xq(t) has the structure provided by (l 6 ^ . and Xe{t) has the structure provided 
by (TTal i (if 1{Q) < | 2 l|), respectively; 

5. in the fifth part, it is proven that, if t* > 7 a,(,)+i —X 2 ,qG {1,..., Q — 1} or fg > —X 2 , then there is 

at t = tq a discontinuity in x°{t) at which it jumps upwardly from xi to —f+ 7 ai(,)+i ^ X 2 , q G {1,. ■., Q}, 
that is, Xq{t) in (l4cl i has the structure of (Ihht or (l 6 dl i or Xe{t) in (l4bl i and (l4cl i has the structure of (iTbl i; 

6 . in the sixth part, it is proven that, if < jai — xi or < 7a,(,)+i — xi, q G {1,..., Q — 1}, then 

there is at f a discontinuity in x°{t) at which it jumps upwardly from —t + 7 oi(,)+i > xi to X 2 , 

q G Q}, that is, Xs{t) in (l4bl l and (l4cT l has the structure of (ISbl i or Xq{t) in (l4cl l has the structure 

of (l 6 ^ or (l651 l; 

7. in the seventh and last part, algorithm [1] which allows determining time instants tOj, j = 1,..., |-B|, is 
described. 


First part 

Consider the case \B\ = 0, which implies fl = 0 and then T = 0 and (5 = 0. Moreover, 1(0) = 0. If | 2 l| = 0 as 
well, all the slopes of f{x + t) are less than v, then, f{x + t) + g(x) is a strictly decreasing function of x, V t. In 
this case, the minimum of the function f{x + t) + g{x), with respect to [xi,X 2 ], is always obtained at X 2 . Thus, in 
this case, x°{t) has the structure provided by (l4al i. with Xe{t) provided by (TTcl i. being 1{Q) = |2l|. 

If \A\ > 0, it is definitely \A\ = 1 = l(Q) + 1. In this case, the slopes of f{x + t) are less than ly in the interval 
(— 00 , 7 a,(Q)^.i) and greater than or equal to 1 / in [ 7 a,(Q)_,.i, + 00 ). This case is very similar to that considered in 
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lemma 1 of m. When t is such that X2 < 7a,(Q)+i — t (that is, t < 7a,(Q)+i — X2), the minimum with respect 
io X, xi < X < X2, of f{x + t)+ g{x) is obtained at X2- When t is such that xi < — t < X2 (that is, 

7 a,(Q)+i - X2 <t < 7 ai(Q)+i - Xi), the function /(x + f) + g{x) is sti'ictly decreasing in [xi,7o,(q)^i - t] and 
nondecreasing in [7a,(Q)+i — X2]', then, it has a minimum, with respect to [xi, X2], in 7^^ — f; when t increases 

in the interval [7ai(Q)+i — X2,'yanQ-)+i — the minimum decreases (with unitary speed) from X2 to xi. Finally, 
when t is such that Xi > — t (that is, t > 7a,(Q)_,.i — xi), the minimum is obtained at Xi. Thus, in this 

case, x°{t) has the structure provided by (l 4 al i. with Xe(f) provided by (fTal i. being 1 {Q) < |A|. Note that, since 
tg = —00 when Q = 0, it is tg < 7a,(Q)^.i — X2 for sure. 

Second part 

Consider the case |A| > 1 and \B\ > 0 , and assume 7f,^. — 70^. > (x2 — xi), V j = 1 ,..., \B\, and 703+1 — 7&3 > 
(x2 — xi), Vj = 1 ,..., |A| — 1 . Under such hypotheses, the function x°{t) is defined as follows. 

1 . When t is such that the slopes of /(x + t) in the interval [xi, X2] are less than z/, that is, Vf < 7ai — X2, 
Vf e [jbj - rci, 703+1 - X2), j = 1 ,..., |A| - 1 , and Vf > 76131 - xi if \A\ = \B\, the minimum of 
the function /(x + t) + g{x), with respect to [xi, X2], is obtained at X2, since /(x + f) + g{x) is strictly 
decreasing in [xi, X2]. 

2 . When t is such that 703 - t € [xi, X2], j = 1 ,..., \A\, that is, Vf e [703 - X2,703 - xi), j = 1 ,..., \A\, 
the function /(x + f) + g{x) is strictly decreasing in [xi, 703 — f] and nondecreasing in [703 — t, X2]; then, 
it has a minimum, with respect to [xi, X2], in 70^ — f; when t increases in the interval [70^ — X2,703 — xi), 
the minimum decreases (with unitary speed) from X2 to xi. 

3 . When t is such that the slope of /(x + t) in the interval [xi, X2] is grater than or equal to z/, that is, Vf € 
[703 — 2^1,7b3 — X2), j = 1 , • ■ ■, \B\, and Vf > 7a|^| — xi if |A| > \B\, the minimum of the function 
/(x + t) + g{x), with respect to [xi,X2], is obtained at Xi, since /(x + t) + g{x) is nondecreasing in 
[X1,X2]. 

4 . When t is such that -fbj — t £ [xi,X2], j = 1 ,. ■., \B\, that is, Vf £ [7^3 — X2,7bj — xi), j = 1 ,..., \B\, 
the function /(x + t) + g{x) is nondecreasing in [xi, 7^3 — t] and strictly decreasing in [76^. — t, X2]; then, 
it has a maximum, with respect to [xi, X2], in x = 7^3 — t, and the minimum is obtained either at Xi or X2, 
depending on the values /(xi + 1 ) +g{xi) and /(x2 + t)+ g{x2), t £ [7^3 — X2,763 — xi) (the minimum is 
obtained at x° = xi if /(xi +t)+ g{xi) < f{x2 + t) + g{x2) and at x° = X2 otherwise). In this connection, 
note that: 

• when t = "fbj - X2, it is certainly /(xi +t) + g{xi) < f{x2 + f) + g{x2)', 

• when t increases in the interval (76^. — X2,763 — xi), the value of /(xi +t)+g{xi) increases or remains 
constant and the value of /(x2 + f) + g{x2) decreases; 

• when t = "fbj — xi, it is certainly /(xi +t) + g{xi) > f{x2 + t) + g{x2)- 

This means that it certainly exists Wj £ [7^^—X2,763 — xi) such that/(xi+f)+5(xi) < f{x2+t)+g{x2) 
'it £ [76^. -X2,a;j), /(xi +a;j)+p(xi) = /(x2+a;j)+p(x2), and f{xi+t) + g{xi) > f{x2+t)+g{x2) 
'it £ {ujj, 76- — xi); then, the minimum is obtained at xi Vf S [7b — X2,ujj), “jumps” from xi to X2 at tUj, 
and is obtained at X2 Vf € [oz^, 7^3 — Xi). 

Thus, according to the previous “rules”, since fiQ = 0 the function x°(t) is X2 at the beginning (rule[T]i, decreases 
with slope —1 in the interval [7ai — X2,jai — 2:1) (rule|2]i, is equal to xi from ^ai — to ozi, at which it jumps 
to X2 (rules | 3 ] and | 4 |i; x°{t) remains equal to X2 from wi up to ja2 ~ X2 (rules | 4 ] and [T]i, then it descreases with 
slope —1 in the interval [702 — X2,702 — 2:1) (rule|2]i, is equal to xi from ja2 ~ xi to 102, at which jumps to X2 
(rules | 3 ] and | 4 |i, and so on. In its last part, the function x°(f) is xi if | 7 l| > \B\ or X2 if | 4 l| = \B\, in accordance 
with rules [ 3 ] and [ 1 ] 

Time instants uij £ [7^3 — X2, jbj — xi), j = 1 ,..., \B\, are those for which it results /(xi + ujj) + g{xi) = 
f(x2 d- ujj) + g{x2)- They can be determined through a simple procedure which analyzes the values within the 
interval [xi, X2] of the piece-wise linear function /(x + t) + g{x), during its leftward movement (when t increases 
from t = 'jbj — X2 up to f = 7^3 — xi). Consider figure| 4 ]which illustrates an example of function /(x + t) + g{x) 
when t = "fbj —X2 (only the part which belongs to the interval [x2 — (x2 — xi), X2 + (x2 — 2Zi)] = [xi, 2x2 — xi] is 
reported, and note also that the vertical value is not meaningful in the search of the abscissa at which the minimum 
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Figure 4 : Example of function f{x + t) + g{x), when t = — X2- 


is obtained). Let d = f{x2 + f) + g{x2) — f{xi + f) + g{xi). Without considering the upward movement of the 
function (which is not important for the determination of ujj), when t increases the function moves leftward and d 
is reduced. As an example, in figure| 5 ]the same function f{x + f) + g{x) is illustrated when f = 7f, _3 — rci. It is 
evident that ojj is the time instant at which d is null. 





■e-- 

Figure 5 ; Example of function f{x + f) + g{x), when t = — xi. 

On the basis of such considerations, with the considered assumptions, to compute ujj it is possible to use the 
following algorithm (which is not formally described, but the reader can refer to the description of algorithm [T] 
which generalizes the following one). 


SECTION A - INITIALIZATION 

1- he - 1} : 

Ih < Tbj - {X2 - Xi) < 7/1+1 

2- . i = bj 

3 : if j = \B\ and |A| = \B\ then 
4: ^i+1 “ ^ f 

5: 7m+1 = +00 

6 : end if 

7 : k e \^bj ^ ^ Qj^i 1 } . 


Ik < Ibj + {x2 - a;i) < 7fe+i 
8: for p = /i to fc do 
9 : fip = g,p-v 

10 : end for 

11: r = 76^ - {X2 - a;i) 

12: 0 = 7b, 

13: d = p-hilh+l - t) 

14: h < bj — 1 then 

15: d = d + X/p=b+l Tpilp+i ~ Tp) 
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16: end if 

17 ; X = h 
18 : ^ = i 

SECTION B - LOOP 
19 : while h < bj and i < /c + 1 do 
20: Ip = min{7;,+i - r, 7^+1 - 0 ) 

21 : if 7/^+1 - r < 7i+i - 0 then 

22 : \ = h + l 

23 : end if 

24: if 7/j+i - T > 7i+i - 9 then 

25: ^ i + 1 

26 : end if 

27 : 5 = - (r + tp)] 

28 : if A < ^ — 1 then 

This algorithm provides, for any j = 1,..., \B\, the time instant ujj at which ajump discontinuity in x°{t) occurs. 
Since ujj < +00 V j = 1,..., |i?|, then T = Q, being Cl = {cui ,... , W|_b|}. Moreover, Q = = ojq, 

andl{q) = q,^ q = 1,... ,Q. Then, it is possible to write G -a:2,7h,(,) -a:i)>7b,c,) > (a; 2 -a;i), 

V g = 1,..., Q, and 7a,(,)+i - 7fc,(<2) > (212 - an), Vg = 1,... ,Q (if 1{Q) < | A|) or V g = 1,..., Q - 1 (if 

1{Q) = | 2 l|), which imply f* > 7 a,(,) - xi Vg = 1,..., Q and f* < 7a,(,)+i - ai 2 Vg = 1,..., Q (if ^(Q) < |A|) 

or Vg = 1,..., Q - 1 (if ^(Q) = |A|). 

Then, x°{t) has the structure provided by (l4bl i or (l4cT i. with Xs{t) provided by (fSal i. Xq{t), q = 1,..., Q — 1 , 

Q > 1, provided by (l6al l. and Xe(f) provided by (fTal i (if 1{Q) < | 2 l|) or (fTcl i (if 1{Q) = |A|). 


29: <5 — (5 + X/p=A+l Ap(7p+1 7p) 

30: end if 

31: (5 = i5 +/i5[(0 + V') — 75] 

32: if (5 < 0 then 

33: w, = r - an + 

34: exit algorithm 

35: else 

36: h = \ 

37: i ^ 

38: T = T -\- Ip 

39: 9 = 9 + 4) 

40: d = S 

41: end if 

42: end while 


Third part 

It has been shown in the second part of the proof that, under the assumptions ^b- — la- > {x2 — xi),\/ j = 
\B\ > 0 , and laj+x - Ibj > {x2 — Xi), Vg = 1 ,..., |A| — 1 , \A\ > 1 , there exists, for each value bj, 
j = 1 ,..., \B\, a finite value ujj G [ibj — X2,lbj — aii) at which x°{t) jumps to X2. In other words, there are \B\ 
points of discontinuity in the function x°{t). In presence of a narrower intervals, this is not necessarily true. 

As a matter of fact, in connection with two consecutive time intervals [7;,^. — t, 7aj+i — t) and [laj^-i — t, Ibj+i — t) 
which are such that ibj+i —Ibj < {x2—xi), when, for any t G [laj+i —X2, min{7t,^. —xi, 7aj^2 “^2}), at least one 
of the two conditions/(xi+<)+p(xi) < f (laj+i )+g(la,+j-t)andf{x 2 +t)+gix 2 ) < filaj+J+gilaj+j-t) 
is satisfied, then the local minimum at 7a +1 — f is never the absolute minimum in the interval [xi,X2]. Then, in 
this case, the presence of the abscissa ibj, at which the slope of f{x + t) changes from a value greater than or 
equal to 1/ to a value less than v, does not cause the function x° (t) to jump in an upward direction. 

To show this, consider the example of function f{x + f) + g{x) illustrated in figurea), when t = ibj — X2, 
in which it is ibj+i — Ibj < {x2 — Xi). When t = ibj — X2, the minimum with respect to [xi,X2] is obtained 
at xi. If f{xi +t)+ g{xi) < filaj+i) + g{laj+i - t) when t = laj+j - X2 (see figure [gb)), that is, if 
filaj+i — X2 + Xi) + g{xi) < f{iaj+i), then the minimum certainly remains at Xi when t increases in the interval 
[ibj - X2,laj+j - X2), since f(x + t) + g{x) is sttictly decreasing in [7;,^. - t, laj+j - t). 

When t increases in the interval [laj+i - X2,lbj+i - X2), if /(xi + t) + g{xi) < f{laj+i) + g{laj+i - t) 
for all t in such an interval, then the minimum is once more at xi, since /(x + f) + g{x) is nondecreasing 
in [7aj+i ~ t,lbj+i — t). When t increases in the interval \lbj+i — X2,laj+2 — X2), if at least one of the two 
conditions /(xi + t) + g{xi) < /(7a,+1) + g(7a,+i - t) and /(x2 + t) + g{x2) < /(7a,+1) + g(7a,+i - t) 
is satisfied, then the minimum is at xi (if /(xi + t) + g{xi) < /(x2 + t) + g{x2)) or at X2 or 7a,+2 “ f (if 
/(xi + f) + g(xi) > /(x2 + t) + g{x2)). More specifically, the minimum jumps from xi to X2 (or to 7a,+2 “ f) 
when t is such that /(x, + f) + g(xi) = /(x2 + t) + g(x2) (see figurej^c)); however, such ajump in an upward 
direction has to be associated with abscissa ibj+j and not with ibj. 

Note that, assumption 76,+, — 76, < (x2 — Xi) is a necessary condition, because in case 76,+, — 76, > (x2 — Xi) 
there is definitely a time instant t at which the local minimum at 7a,+i — f is the absolute minimum in the interval 

[X1,X2]. 
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(a) (b) 




Figure 6: Example of function f{x + f) + g{x), (a) when t = jbj — X2, (b) when t = 7aj+i — X2, and (c) when 
t : f{xi +t)+ g{xi) = f{x2 +t)+ g{x2). 


Algorithm[T]determines in the section C (“second loop”) if the local minimum at 7^ ^^ — f is the absolute minimum 
in the interval [xi,X2]- Such a part of the algorithm (rows I 79 lt-l 9 ^ and II 14 h - 11191 1 moves the function f{x + 
t) + g{x) in a leftward direction (by increasing the time variable r) until that the value of the function at the 
local minimum — f is lower than or equal to the value of the function at xi or, equivalently, until that 

f{xi + t) + g{xi) > + gilaj+i — t). When this happens, it results 5 < 0 . At that point, the algorithm 

determines (at rows l 93 lt- II 13 l l if there is a value of the function f{x + t) + g{x) in (7a +1 — C [xi,a;2] 
which is lower than the value of the function at the local minimum 7a +1 — f or, equivalently, if it exists t such that 
f{x2 + t) + g{x2) < fi'Jaj+i) + gilaj+i — t). In the algorithm, such a lower value exists when <)) < 0 ; in this 
case, ujj is set to the nonfinite value +c)0 and the algorithm ends since there is no more the possibility that the local 
minimum becomes an absolute minimum (since f{x + t) + g{x) is strictly decreasing in [76^+1 — t, 7aj+2 “ 0)- 

In conclusion, it has been shown in this part of the proof that some of the abscissae jb- — t, j 
may not cause a jump discontinuity in x° (t). Then, x° (t) has a number of discontinuities (at which it jumps in an 
upward direction) equal to Q < \B\. In accordance with the notation adopted in algorithm [T] values ujj < +00, 
j € { 1 ,..., |-B|}, are those actually corresponding to jump discontinuities. These Q values are denoted as t*, q = 
1 ,... ,Q. The link between values uij and t* is represented by the mapping function l{q) = j, j G { 1 ,..., |i 3 |}, 
q = (that is, l(q) = j ujj = t*). 

From now on, only the Q abscissae 7b, — t, q = 1 ,... ,Q, and the Q + 1 abscissae jai and — t, 

q = 1 ,... ,Q, will be taken into account, to prove that, when Q > 1 , x°{t) has the structure provided by (Hbl i 
or (l 4 cl i. with Xs{t) provided by one of the (| 5 ]l, Xq{t), q = 1 ,..., Q — 1 , Q > 1 , provided by one of the (|6ll, and 
Xe{t) provided by one of the (| 7 ]i. 


Fourth part 

Consider the case Q > I, and assume that 7a,(,)+i - 7 bi(,) < (^2 - xi) and 7 bi(<,)+i “ Ta,(,)+i < (x2 - xi) 
for some q G Q}. An example of such a case is illustrated in figure | 7 ] Note that, in accordance with 

the considerations made in the third part of the proof, regarding the time instants which actually produce a jump 
discontinuity in x°{t), such assumptions imply l{q) + 1 = ((q + 1) and l{q) + 2 = l{q + 1 ) + 1 = l{q + 2). 
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(a) 


(b) 



The condition t* < — X2 means that a discontinuity occurs att = t*, at which x°{t) jumps to X2, from 

eitherxi or -fq+7ai(,) (dependingif -xi ort* < -xi,respectively). Infigure|2l f{x+t)+g{x) 

when t = t* is illustrated. In accordance with the rules discussed in the second part of the proof, when t increases 
from t* to 7a,(g)+i — X2, the minimum remains at X2- Moreover, when t increases from 7a,(^,^1 — X2 on, the 
minimum decreases with unitary speed from X2 towards xi. 

The condition > 7a,(,)+i — xi means that the minimum, which is decreasing, reaches xi when t = 7a,— 
xi, and remains at xi in the interval [7a,(,)_,.i — Xl,t*_^_l). Alt = a discontinuity occurs, at which x°{t) jumps 
from xi, to either X2 or + 7ai(5)+2 (depending if < 7a,(,)+2 “ 2:2 or > 7a,(,,+2 - X2, respectively). 

Then, in case t* < 7a,(,)+i — X2 and > 7a,(,)+i — Xi, the function x°{t) between time instants t* and 
has the structure provided by (1^ . 

When 9 = 0 , the function f{x + f) + g{x) is strictly decreasing in (—00,7ai — f); then, the minimum is obtained 
at X2 for all t < 'jai — X2- When t increases from jai — X2 on, the minimum decreases with unitary speed from 
X2 towards Xi. The condition t\ > 7ai — xi means that the minimum, which is decreasing, reaches xi when 
t = 7ai — xi, and remains at Xi in the interval [7ai — Xi,t\). Ait = t\ a discontinuity occurs, at which x°{t) 
jumps from xi, to either X2 or —t\ + ^ao, (depending if t\ < 7a2 — X2 or t\ > ^a2 ~ X2, respectively). Then, in 
case > 7ai — xi, the function x°{t) before time instant has the structure provided by (l 5 ^ . 

When q = Q, if tq < 7a,(Q)+i — X2, then a discontinuity occurs at t = tq, at which x°{t) jumps to X2, from 
either xi or —tq + 7a,(Q) (depending if tq > 7a,(Q) — or tq < — Xi, respectively). In accordance 

with the previous considerations, the minimum remains at X2 in the interval [fQ,7a,(Q)+i — X2), decreases with 
unitary speed in the interval [7a,(Q)^.i — 2:2,7a,(Q)+i — xi), and remains at xi from t = 7a,(Q)_,.i — xi on, since 
/(x + t) + g{x) is nondecreasing in [7a,(Q)+i — xi, +00). Then, in case tq < 7a,(Q)+i — X2, the function x°{t) 
after time instant tq has the structure provided by (Ell). 


Fifth part 

Consider the case Q > 1 , and assume that 7a,< (2^2 — a^i) and “Ta,(,) > (x2 — xi) for some 

9 G { 1 ,..., Q - 1 }. If f* > 7a,(,)+i - 2:2, then /(xi +t)+ g{xi) < f{x2 + t) + g{x2) when t = 7a,(,)+i - X2, 
that is, /( 7 a,(,)+i — X2 + Xi) + 9(xi) < /( 7 a,(,)+i), as in the case illustrated in figureOa). When t increases from 
7 a,(,)+i “2;2 on, the local minimum at 7a,(,)+i —t decreases with unitary speed from X2 towards Xi. Thus, t*, which 
corresponds to the finite value a;;(q), is the time instant at which /(xi +1) + 9(xi) = /(7a,(,)+i) + 5(7a,(,)+i — t), 
as it is illustrated in figurejS^b). At t*, the minimum within [xi, X2] jumps from xi to —t* + 7a,(g)_,.i ■ Then, Xq (t) 
in (l 4 cl l has the structure of d&bl i or (l6dl) (depending on the value t*^^, as discussed in the following part of the 
proof). 

Consider now the same case in which 7a,(,)+i — 7 bi(,) < {x2 — xi), for some 9 G { 1,...,(5 — 1 }, but without any 
assumption about the interval [7a,(,), 7a,(,)+i )■ In this case, when t = 7a,(g)+i — X2, one or more local minima are 
present in the interval [xi, X2], as in the cases illustrated in figure| 9 ta). In accordance with the considerations made 
in the third part of the proof, regarding the time instants which actually produce a jump discontinuity in x°{t), if 
i*q > 7a,(,)+i ~ X2, then, when t = 7a,(,)+i — X2, the global minimum in [xi,X2] is at abscissa 7o,(,_i)+i — t 
(see again figure 0 a)). As before, when t increases from 7o,(,)+i — X2 on, the local minimum at 7a,(,)+i — t 
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(a) (b) 



Figure 8: Example of function f{x + f) + g{x), (a) when t = — X2 and (b) when t = t*. 


decreases with unitary speed from X2 towards xi, and t* is the time instant at which f{xi + f) + g{xi) = 
/(7a,(,)+i) + gila^g-j+i — t), as it is illustrated in figurel^b). At the minimum within [xi, 2:2] jumps from xi 
to —t* + 7ai(,)+i- T^en, Xq(t) in (l 4 cl i has the structure of dbbl i or (l6dl i (depending on the value fj+i). 


(a) (b) 



Figure 9 : Example of function f{x + f) + g{x), (a) when t = 7a,(,)+i — X2 and (b) when t = t*. 


The same considerations can be made when q = Q, in the case 1 {Q) < |A|. If tg > 7a,(Q)+i — X2, at tg the 
minimum within [xi, X2] jumps from xi to —tg + and then Xe(f) in (l 4 bl l or (l 4 cl) has the structure of (fTbl l. 

Sixth part 

Consider the case Q > 1 , and assume that 7b,(,+i) - 7a,(,)+i < {x2 - xi) and 7a,(,+i)+i - 7a,(,+1, > {x2 - Xi) 
for some g C { 1 ,..., Q — 1 }. When t = — X2, the minimum within [xi, X2] (which is decreasing with 

unitary speed since t was equal to 7a,(g)+i — X2) is at 7a,(g)+i — t, as in the case illustrated in figure fTOl' a'). If 
fq+i < 7a,(,)+i — xi, then the minimum jumps to X2 before than (or exactly when) it reaches xi, that is, the 
minimum jumps from 7a,(,)+i - f > xi to X2. is the time instant at which /(7a,(,)+J + 5(7a,(,)+i - t) = 
f{x2 + f) + g{x2), as it is illustrated in figureOb). Then, Xq{t) in dTcl) has the structure of (l6^ or dbdl l (depending 
on the value t*, as discussed in the previous part of the proof). 

Consider now the same case in which 7b,—7a,< (x2—xi), for some g G { 1 ,Q —1}, but without any 
assumption about the interval [7a,(,+i), 7a,(g+i)+i )■ In this case, when t = 'jbug+i-, — X 2 , one or more local minima 
are present in the interval [xi, X2], as in the cases illustrated in figure fTTT al. In accordance with the considerations 
made in the third part of the proof, regarding the time instants which actually produce a jump discontinuity in x°(f), 
the global minimum in [xi, X2] is at abscissa — t, as before. Then, also in this case, if fA < 7a,(,,^1 — xi, 

then the minimum jumps, at from 7a,(,)+i — f > xi to X2- In conclusion, Xq{t) in has the structure 

of (l6^ or dbdl l (depending on the value t*). 

The same considerations can be made in connection with time instant when 7b,— 7ai < (2^2 — a:i). In this 
case, if < 'jai — xi, then the minimum jumps from -jai — t > xi to X2, and then Xs(t) in (l 4 bl l or (l 4 cl) has the 
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(a) (b) 



Figure 10 ; Example of function /{x + t) + g{x), (a) when t = 7b,— X2 and (b) when t = tg+l 


(a) (b) 



Figure 11 : Example of function f{x + f) + g{x), (a) when t = 7 b,(,+1) — X2 and (b) when t = 


structure of (l 5 bl i. 


Seventh part 

The algorithm which computes the value ujj, in correspondence with abscissa 7 b , considers the function f{x) + 
g{x) and the “window” [7b^ — (x2 — xi), 7b„], which is moved rightward to hnd the instant at which the minimum 
of the function within the window “jumps” from the left bound to the right bound, as discussed in the previous parts 
of the proof. Note that, considering the function f{x) + g(x) and the window Yli,. — {x2 — a^i), ^bj] is equivalent 
to consider the function f{x + f) + g{x) with t = jbj — X2 and the window [xi, X2]. 

Basically, to determine the time instant at which the minimum within the window jumps in an upward direction, if 
it exists (as discussed in the third part of the proof), the algorithm moves the window rightward until the difference 
d between the value of /(x) + g{x) at the right bound 9 of the window (or at the local minimum which is the 
nearest to the right bound) and its value at left bound r of the same window (or at the current global minimum 
within [ t , 9 ]) becomes null. Since /(x) + g{x) is a piece-wise linear function, the window is repeatedly moved 
of intervals whose lengths ijj correspond to the lengths on the abscissae axis of the segments of the function. At 
each step, the new difference 6 is computed and, if S turns out to be null or negative, then the minimum has 
jumped to the right bound; this also means that the time instant ujj is within the last rightward movement, that is, 

UJj G [t — Xi, T — Xi + Ip). 

In the “Section A - Initialization” part of the algorithm, the segments of the piece-wise linear function /(x) + g{x) 
which are included in the interval — {x2 — xi), ^bj], and those of the interval ['^bj , Ibj + {x2 — a^i)] that could 
“enter” the window when it moves rightward, are determined (rows 1 - 75 ); the slopes of /(x) + g{x) are computed 
for any of those segments (rows 6 ^ 11 ); the initial values of the left and right bounds t and 0 are set (rows 12 - 713 ), 
and the initial value of d is calculated (rows 14 ^ 19 ). Note that, the min operator in the determination of d is 
necessary to compute d when the minimum within [7b^ — (x2 — xi), 7b„ ] (that is, at the beginning) is not obtained 
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at the left bound but is obtained at an abscissa greater than 'jb ■ — {x 2 — xi) (as for example, in the cases illustrated 
in figures fTOl a) and fTlT all. 

In the “Section B - First loop” of the algorithm, the while loop allows moving, segment-by-segment, the window 
[r, 9 ] leftward. At each step of the while loop, the length ip of the next rightward movement is determined (row 
23 ) and the new difference 6 is computed (rows 30 -^ 42 ). If (5 < 0 , then tOj can be determined (through one of the 
equation at rows 59 , 61 , 64 and 68); otherwise all values and indexes are updated (rows 12 ^ 16 ) and another step 
of the loop is executed. It is worth noting that several equations to compute uij must be provided because of the 
possible presence of local minima within the moving window [r, 0 ]; in this connection, values x (rows 48 -;- 51 ) are 
the relative value at the local minima (relative with respect to the value at the left bound of the window), and m 
(rows 52 -;- 56 ) is the relative value at the global minimum; note also that all local minima, if present, are before 


lb, € [t,9]. 


In the hrst loop, the window is moved until its right bound reaches abscissa 7aj+i- This means that, if ujj is 
determined within the hrst loop, then the new minimum is dehnitely obtained at X2, since f{x) -f g(x) is strictly 
decreasing in , 7aj+i )■ In case the minimum did not jump during the hrst loop (or, equivalently, if ujj has not 
been determined during the hrst loop), then the algorithm executes another loop in which, again, the window is 
moved rightward; the difference with respect to the hrst loop is that now the local minimum of f{x) + g{x) at 
7aj+i is within the window. 

In the “Section C - Second loop” of the algorithm, as before, the while loop allows moving, segment-by-segment, 
the window [t, 9 ] leftward and, at each step of the while loop, the length ip of the next rightward movement is 
determined (row 80 ) and the new difference 5 is computed (rows 827 - 92 ). If 5 < 0 , then a nonhnite or a hnite 
value of ujj is determined (respectively at rows 106 or 112); otherwise all values and indexes are updated (rows 
1157 - 117 ) and another step of the loop is executed. In this second loop, the window is moved until its left bound 
reaches abscissa Xbj, but the algorithm certainly exits before then. 

It is important to observe that when it results ^ < 0 , it is necessary to analyze the shape of /(x) -F g{x) in the last 
part of the window, that is, from 70^+1 to 0; as a matter of fact, it is possible that, when the value of f(x) + g{x) at 
the abscissa 7aj+i becomes lower than or equal to all the values in [r, it is not the global minimum in [r, 9 ] 

because a lower value is obtained in (703+1, 9 ] (such a lower value exists when (p, determined at rows 987 - 104 , is 
negative); this is the case in which the presence of a local maximum at Xbj do not produce a jump discontinuity in 
x°{t), as discussed in the third part of the proof. In this case, ujj is conventionally set to 7-00. 

This concludes the proof. □ 

Lemma[T]is still valid when f{x) = c ^ 0 for any x < 71. Moreover, Lemma[T]can be easily extended to consider 
the more general case in which the slope of function /(x) is not null at the beginning, that is, po 0- 

Lemma 2. With reference to the functions /(x + t) and g{x), as considered in Lemma [ 1 ] and to the function 
x°{t) = argmini;{/(x + t) + ^(a;)}, xi < x < X2, provided by Lemma[T]itself, the function 


h{t) = f{x°{t) +t) + g{x°{t)) 


( 8 ) 


is a continuous, nondecreasing, and piece-wise linear function of the independent variable t, that can be obtained 
by f{x + t) and x°{t) as follows: 

• h{t) is equal to /(x2 + t) for all t in which x°{t) = X2; 

• h{t) is a linear segment with slope 1/ for all t in which x°{t) decreases with slope —1; the vertical alignments 
of such segments are such that h{t) is a continuous function; 

• h{t) is equal to /(xi 7 - f) 7 - i^{x2 — xi) for all t in which x°{t) = xi. 


Then: 



Vi : x°{t) = X2 
Vf : x°{t) ^ {xi,X2} 
Vf : x°{t) = xi 


( 9 a) 
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r f{x 2 + 1 ) 

Vf : x°{t) = X2 


ifQ = 1 

: h{f) = 

vt+[f{'^a^)-v{-iag-X 2 )\ 

+ [/( 7 a,(Q) + i) - i^( 7 a,(Q) + i - 2:2)] 

Vt < t* : x°{t) f {xi,X2} 

Vt>t* : x°(t) f {xi,X2} 

( 9 b) 



1 f{Xi +t) + V{X 2 - Xi) 

Vt : x°{t) = xi 




f{x 2 +t) 

Vt : x°{t) = X2 




Vt+ [/( 7 ai) - J^( 7 ai -2:2)] 

Vt <t\: x°{t) 7^ {a;i,a;2} 


ifQ > 1 

h{t) = < 

Vt + [/( 7 a,(,) + J - i^( 7 a,(,) + i - 2:2)] 

Vt € : x°(t) 7^ {a;i,X2} 

( 9 c) 



Vt + [/( 7 a,(Q)+i) - ^^( 7 a,(Q)+i - 2:2)] 

Vt>t*Q: x°{t) f {a;i,a;2} 




^ f{xi +t) + V{X 2 - Xi) 

11 

0 

H 

> 


Proof. When x 

= X2, it is g{x) = 0 (see figure| 3 ]i; then, when x°{t) 

= X2, function h{t) = f(x2 + t). Instead, 


when X = xi, it is g{x) = v{x 2 — xi) (see again figure^; then, when x°{t) = xi, function h{t) = f{xi + f) + 
v{x2 - Xi). 

When 7ai — X2 < t < jai — xi, with regards to (fSal i. x°{t) passes linearly (with unitary speed) from the value 
X2 3 l t = 7ai — X2 to the value xi at t = jai — Xi', then, in the same interval, function h{t) passes, with 
the same dynamics (that is, linearly), from the value f{x2 + 7ai — X2) = fijai) (at t = 'jai — X2) to the value 
f{xi+^ai—xi)+i'{x2—xi) = f('jai)+i^(x2—xi) (alt = 7^^—a;i); the Segment whichjoins such values belongs 
to the line + [/(7ai) — I'ilai —X2)\ - In the same way, when 7^^ —X2 <t <t\, with regards to dSb]), x°{t) passes 
linearly (with unitary speed) from the value X2 at f = 7^^ — X2 to the value —t\ + 7aj att = t\', then, in the same 
interval, function h{t) passes linearly from the value f{jai) (at t = jai —X2) to the value / (7ai) + r^(a;2 + fi — 7ai) 
(at t = f^); the segment which joins such values belongs again to the line vt + [/(7ai) — i^(7ai — 2;2)]. This 
proves that, when t : x°{t) ^ {a;i,a;2} in ( l 9 a] i, and when t < : x°{t) ^ {a;i,a;2} in ( l 9 b] i and ( | 9 ^ . function 

h{t) = vt+ [/(7aj ) - J/(7aj - 0:2)]. 

In analogous way, when 7ai(,)+i — X 2 < t < 7a,(,)+i —xi,q= 1,... ,Q, with regards to or (TTal l. x°{t) passes 
linearly (with unitary speed) from the value a::2 at f = 7ai(,)+i — X 2 to the value xi at f = — xi, function 

h{t) passes linearly from the value J (at f = 7a,(,)+i - X 2 ) to the value /(7a,(,)+i) + i'{x 2 - a;i) (atf = 

7ai(,)+i —Xi), and the segment which joins such values belongs to the line i^i+[/(7a,(,)+i) —r^(7a,(,)+i “2:2)]. In the 
same way, when t* < t < 7a,(,)+i —xi,q= 1,..., Q, with regards to dhbl i or dTbl) . when 7a, —X 2 <t< 

q= 1,..., Q — 1, with regards to (l6^ . and when t* < t < q = 1,... ,Q — 1, with regards to (l6dl) . function 
h{t) passes linearly from two values which are connected through the line I't+lf {jang-^+i) — ~2;2)]- This 

proves that, when f > f* : x°{t) ^ {xi, X2} in ( l9bb , when t G [t*, : x°{t) ^ {xi,X 2 }, g = 1,..., Q — 1, 

in (|9c]l, and when t > tg : x°{t) ^ {xi,a;2} in Q, function h{t) = vt + [/(7a,(,,+i) - i^(7a,(,)+i - X 2 )], 
g = l,...,Q. □ 

Note that, when 1{Q) = |A| there isn’t any t > t*Q such that x°{t) ^ {a;i,a: 2 } (since Xe{t) = X 2 for any 
i > tq, in accordance with (fT^l. Then, in this case, the term vt + [/(7ai) — I'ilai — X 2 )] in (l9al) and the term 
[/(7ai(Q)+i) ~^(7ai(Q)+i ” 2 : 2 )] in ( l9bb and ( l9cb have not to be considered as apart of the function h{t). 


Lemma 3. Let /i (x + 1 ) and f2{x + 1 ) be two continuous nondecreasing piece-wise linear functions of x, param¬ 
eterized by t, as defined by definition| 2 ] The sum function 

s{x + t) = fi{x + t) + f2{x + t) ( 10 ) 

is still a continuous nondecreasing piece-wise linear functions of x, parameterized by t, which is in accordance 
with definition | 2 ] 

Proof. It is evident that the sum of two continuous piece-wise linear functions of the same argument is a continuous 
piece-wise linear function of that argument as well; moreover, since all slopes in fi{x + t) and f2{x + f) are 
nonnegative, the slope in a generic segment of s(a; -F t) is nonnegative as well, because it is the sum of two specific 
(nonnegative) slopes of fi{x + t) and f2{x + f); finally, since the initial slope of both fi{x + t) and f2{x + t) is 
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null, also s{x + t) has initial slope null. Then, s(a; + <) is a continuous nondecreasing piece-wise linear functions 
of X, parameterized by t (which is in accordance with definition | 2 ]l. This concludes the proof. □ 


Lemma 4. Let fi{x) and f2{x) be two continuous nondecreasing piece-wise linear functions of x, as defined by 
definition [ 1 ] The min function 

TO(a;) = min{/i(a;),/2(a;)} ( 11 ) 

is still a continuous nondecreasing piece-wise linear functions of x, which is in accordance with definition[T] 

Proof. It is evident that the minimum of two continuous piece-wise linear functions of the same argument is a 
continuous piece-wise linear function of that argument as well; moreover, since all slopes in /i (x) and /2 (x) are 
nonnegative, the slope in a generic segment of m{x) is nonnegative as well, because it corresponds to the slope of 
one segment of /i(x) or one segment of f2{x)\ hnally, since the initial slope of both /i(x) and /2(x) is null, also 
m(x) has initial slope null. Then, m(x) is a continuous nondecreasing piece-wise linear functions of x (which is 
in accordance with definition[T]i. This concludes the proof. □ 
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4 Examples 


4.1 Example 1 

Consider the following functions f{x + t) and g{x) (depicted in the same graphic). 



Figure 12 : Example 1 - Functions f{x + t) and g{x). 


Algorithm[T]provides wi = 13.3 and a;2 = 25 . 6 . Then, by applying lemma[T](taking into account/(x + f), instead 
of f{x), and g{x)) the following function x°{t) is obtained. 


x°{t) 


Xs{t) t < 13.3 
xi {t) 13.3 <t< 25.6 

Xe{t) t > 25.6 


with 


r 8 f < 10 

\ -f+ 18 10 < f < 13.3 


Xl{t) 


8 13 . 3 <t <18 

-t + 26 18 <t <22 

4 22 < f < 25.6 


r -t + 32 25.6 <t <28 
I 4 f > 28 


Note that, T = { 13 . 3 , 25 . 6 }, that is, t\ = 13.3 and = 25 . 6 , and Q = 2. Since T = fl, the mapping function 
is basically 1{1) = 1 and l{2) — 2. Moreover, t* < 7oi — xi = 14 (then, Xs(t) has the structure of (Bbl ll. 

< 7a2 — a;2 = 18 and > 702 ~ xi =22 (then, xi (t) has the structure of d^l. and > 703 — X2 = 24 (then, 

Xe(t) has the structure of dTbl i'). The graphical representation of x°(t) is the following. 



Figure 13 : Example 1 - Functions x°{t). 

By applying lemma| 2 ]the following function h{t) = f{x°{t) + t) + g(x°{t)) is obtained. 
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Figure 14: Example 1 - Function h{t) = f{x°{t) + i) + g(x°{t)). 


In accordance with lemma|2]and, in particular, with (l9^ . function h{t) is 


h{t) = < 


/(8 + f ) 
t - 9 
t- 12 
f- 10 

/(4 + f) + 4 


Vf : x°{t) = 8 

yt<18.3:x°(t)^{A,8} 10 < f < 13.3) 

Vf G [13.3, 25.6) : x°(t) ^ {4,8} 18 < f < 22) 

Vf > 25.6 : a;°(f) ^ {4,8} 25.6 < f < 28) 

Vf : x°{t) = A 
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4.2 Example 2 

Consider the following functions f{x + t) and g{x) (depicted in the same graphic). 



Algorithm[T]provides wi = 11, UJ 2 = 14, and ws = 23. Then, by applying lemma[T](taking into account f{x + t), 
instead of f{x), and g{x)) the following function x°{t) is obtained. 



( Xs{t) 

t < 11 




x°(f) = 

\ Xi{t) 

I X2{t) 

11 < f < 14 

14 < f < 23 





[ Xe{t) 

t > 23 




Xs{t) = I 

' 8 

-t+lt 

t < 8 

1 8 < f < 11 

Xi{t) = —t 

+ 19 



( 8 

14 < f < 18 

1 

r 8 

23 < f < 

X2{t) = \ 

-f + 26 18 < f < 22 

Xe{t) = 1 

-f + 35 

27 <t< 

I 

1 4 

22 < f < 23 

1 

1 4 

t > 31 


Note that, T = {11,14, 23}, that is, = 11, = 14, and fg = 23, and <3 = 3. Since T = fl, the mapping 

function is basically ((1) = 1, l{2) = 2, and ((3) = 3. Moreover, < jai —xi = 12 (then, Xs{t) has the structure 
of (l5blll. > 7 a 2 — a :2 = 11 and < 7 a 2 — a;i = 15 (then, xi{t) has the structure of (l 6 dl)). ^2 < Taa — ^2 = 18 
and fg > 7(13 — *1 = 22 (then, X 2 {t) has the structure of d^l. and fg < 7 ^^ — X 2 =27 (then, Xe{t) has the 
structure of (TTatl. The graphical representation of x° (f) is the following. 



By applying lemma|2]the following function h{t) = f(^x°{t) + t) + g[x°{t)) is obtained. 
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Figure 17: Example 2 - Function/i(i) = f{x°{t) + t) +p(a;°(t)). 


In accordance with lemma|2]and, in particular, with (l9^ . function h{t) is 


' /(8 + f ) 

t-8 


h{t) = < 


t-8 
f- 10 
f- 12 

/(4 + f) + 4 


Vf : x°{t) = 8 

yt <11: x°(t) ^ {4,8} i^8<t<ll) 
yt € [11,14) : x°it) ^ [4, 8} 11 < f < 14) 

yt € [14, 23) : x°it) ^ {4,8} 18 < f < 22) 

Vf > 23 : x°(f) ^ {4,8} (=> 27 < f < 31) 
yt : a:°(<) = 4 
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4.3 Example 3 

Consider the following functions f{x + t) and g{x) (depicted in the same graphic). 



Algorithm[T]provides wi = 9.5 and ijJ 2 = 12.5. Then, by applying lemma[T] (taking into account f{x + t), instead 
of f{x), and g{x)) the following function x°{t) is obtained. 


x°{t) 


with 


Xs{t) 


Xs{t) t < 9.5 
xi{t) 9.5<f<12.5 
Xe{t) t > 12.5 


8 t <8 /y.'i _ / 8 9.5 < f < 11 

-f+16 8<f<9.5 \ -f+19 11 < f < 12.5 


Xe{t) = 


8 12.5 <t<27 

-f + 35 27 <f<31 
4 t > 31 


Note that, T = {9.5,12.5}, that is, t* = 9.5 and = 12.5, and Q = 2. Since T = Vl, the mapping function 
is basically Z(l) = 1 and l{2) = 2. Moreover, t\ < 7 ^^ — a;i = 12 (then, Xs{t) has the structure of (fSbl) '). 
t\ < 7a2 — a;2 = 11 and < 702 — xi = lb (then, a;i(f) has the structure of (He}), and < 7^3 —X2 = 27 (then, 
Xe{t) has the structure of (f7al)l. The graphical representation of x° (t) is the following. 



Figure 19: Example 3 - Functions x°{t). 


By applying lemma|2]the following function h{t) = f(x°{t) + t) + g(x°{t)) is obtained. 
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Figure 20: Example 3 - Function h{t) = f{x°{t) + t) + g{x°{fi)). 


In accordance with lemma|2]and, in particular, with ( |9^ . function h{t) is 


h{t) = < 


/(8 + f ) 
1.5f- 12 
l.ht- 13.5 


1.5f-25.5 


/(4 + f) + 6 


Vf : x°{t) = 8 

Vf < 9.5 : x°{t) 7 ^ {4,8} 8 < t < 9.5) 

Vf G [9.5,12.5) : x°{t) ^ {4, 8} 11 < f < 12.5) 

Vf > 12.5 : x°{t) 7 ^ {4,8} 27 < f < 31) 

Vf : x°{t) = 4 
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4.4 Example 4 

Consider the following functions f{x + t) and g{x) (depicted in the same graphic). 



Algorithm [T] provides oji = 10.3 and 1 x 2 = 22.53. Then, by applying lemma [T] (taking into account f{x + t), 
instead of f{x), and g{x)) the following function x°{t) is obtained. 



t < 10.3 

11 

0 

10.3 < t < 22.53 

Xe(t) 

t > 22.53 


with 

r R f,R f * “® <t<\3 

= | -( + 16 8<(<10.3 + 

I O -Lo L .^^.Oo 


Note that, T = {10.3,22.53}, that is, t* = 10.3 and = 22.53, and <3 = 2. Since T — Vt, the mapping 
function is basically Z(l) = 1 and l{2) = 2. Moreover, t\ < jai — a;i = 13 (then, Xs{t) has the structure of (l5bl i). 
t* < 7^2 — a ;2 = 13 and > 702 — rci = 18 (then, xi{t) has the structure of dhatl: since 1{Q) = |r 4| = 2, the 
function Xe{t) has the structure of (fTcl i. The graphical representation of x° (f) is the following. 



Figure 22: Example 4 - Functions x°(t). 

By applying lemma|2]the following function h{t) = f{x°{t) + f) + g{x°{t)) is obtained. 
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Figure 23: Example 4 - Function = f{x°{t) + i) +g(^x°{t)). 


In accordance with lemma|2]and, in particular, with (l9^ . function h{t) is 


h{t) 


f{8 + t) 

t-7 

t-9 

/(3 + f) + 5 


Vf : x°{t) = 8 

Vf < 10.3 : {3,8} 8 < f < 10.3) 

Vf G [10.3, 22.53) : x°(t) ^ (3, 8} 13 < f < 18) 

Vf : x°{t) =3 
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4.5 Example 5 


Consider the following functions f{x + t) and g{x) (depicted in the same graphic). 



Figure 24: Example 5 - Functions f{x + t) and g{x). 


Algorithm[T]provides toi = 11 and W 2 = 19.6. Then, by applying lemma[T] (taking into account f{x + t), instead 
of f{x), and g{x)) the following function x°{t) is obtained. 

( Xs{t) f < 11 
= S xi{t) 11 < f < 19.6 
\ Xe(t) t > 19.6 

with 

t < 9 

9 < i < 11 


19.6 < f < 21 
t > 21 

Note that, T = {11,19.6}, that is, t\ = 11 and = 19.6, and Q = 2. Since T = il, the mapping function 
is basically 1{1) = 1 and Z(2) = 2. Moreover, t* < ^a-i — xi = 13 (then, Xs{t) has the structure of (l5bl) ). 
t\ < 7(12 — a ;2 = 15 and > Taa — xi = 19 (then, xi{t) has the structure of d^l. and > 703 — 0:2 = 17 (then, 
Xe{t) has the structure of (fTbl ll. The graphical representation of x°{t) is the following. 



[8 11 < f < 15 

xi{t) = < —t + 23 15 < f < 19 

1 4 19 < f < 19.6 


= { tt+17 

Xe{t) = 1 


Figure 25: Example 5 - Functions x°{t). 

By applying lemma|2]the following function h{t) = f(x°{t) + f) + g(x°{t)) is obtained. 
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Figure 26: Example 5 - Function h{t) = f(^x°{t) + i) + p(a:°(t)). 


In accordance with lemma|2]and, in particular, with ( l9cl i. function h{t) is 


' /(8 + f ) 

0.5f-0.5 


h{t) = { 0.5 f-1.5 


0.5 f-0.5 


/(4 + f) + 2 


Vf : x°{t) = 8 

yt <11: x°(t) ^ {4,8} 9 < f < 11) 

Vf e [11,19.6) : x°(t) ^ {4, 8} 15 < f < 19) 

Vf > 19.6 : a;°(f) {4,8} 19.6 < f < 21) 

Vf : x°(f) = 4 


Davide GIgllo 


DIBRIS - University of Genova 


26 















Fundamental lemmas for the determination of optimal control strategies 
for a class of single machine family scheduling problems 


4.6 Example 6 

Consider the following functions f{x) and g{x) (depicted in the same graphic). 



Algorithm [T] provides wi = +oo and 1 x 2 = 19.16. Then, by applying lemma [T] (taking into account f{x + t), 
instead of f{x), and g{x)) the following function x°{t) is obtained. 




with 


Xs(t) t < 19.16 
Xeit) t > 19.16 


[8 f < 12 

Xs(t) = < —t + 20 12 < < < 16 

I 4 16 < < < 19.16 


Xe{t) 


8 19.16 <t<28 

-f + 36 28 < i < 32 
4 f > 32 


Note that, T = {19.16}, that is, t\ = 19.16, and Q = \. The mapping function provides 1{1) = 2. Moreover, 
t* > 7 ai — a;i = 16 (then, Xs{t) has the structure of (fSal i) and t* < 7^3 — a ;2 = 28 (then, Xe{t) has the structure 
of (TTalil. The graphical representation of x°{t) is the following. 



Figure 28; Example 6 - Functions x°{t). 

By applying lemma|2]the following function h{t) = f{x°{t) + f) + g(^x°{t)) is obtained. 
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Figure 29: Example 6 - Function h{t) = f{x°{t) + t) + g{x°{t)). 


In accordance with lemmal^and, in particular, with ( l9b] ). function h{t) is 


h{t) 


/(8 + f ) 
f- 12 
f- 14.5 
/(4 + f)+4 


'it : x°{t) = 8 
it < 19.16 : x°{t) ^ {4,8} 
it > 19.16 : x°it) ^ {4,8} 
it : x°{t) = 4: 


12 < f < 16) 
(=> 28 < f < 32) 
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4.7 Example 7 

Consider the following functions f{x) and g{x) (depicted in the same graphic). 



Algorithm[T]provides wi = 19.5 and a ;2 = 21.3. Then, by applying lemma[T](taking into account/(x + f), instead 
of f{x), and g{x)) the following function x°{t) is obtained. 


\t) = 


with 


Xsit) = 


Xeit) = 


Xs{t) 

t < 19.5 

Xi(t) 

19.5 < t < 21.3 

Xeit) 

t > 21.3 

8 

t < 12 

-t + 20 12<t<16 

4 

16 < f < 19.5 

8 

21.3 <t<28 

-f + 36 28 < f < 32 

4 

t > 32 

19.5,21.3}, that is, = 19.^ 


Xi{t) = 


-t + 25 19.5<f<21 

4 21<f<21.3 


is basically ^1) = 1 and l{2) = 2. Moreover, > 'jai — = 16 (then, Xs{t) has the structure of (l5ali). 

> 7^2 — X 2 = 17 and > Ja 2 — xi =21 (then, xi (t) has the structure of d&bl i). and < 704 — X 2 = 28 (then, 
Xe (t) has the structure of dTaJi). The graphical representation of x° (t) is the following. 



Figure 31: Example 7 - Functions x°(t). 

By applying lemma|2]the following function h{t) = f{x°{t) + <) + g(x°{t)'j is obtained. 
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Figure 32: Example 7 - Function h{t) = f{x°{t) + t) + g{x°{t)'). 


In accordance with lemma|2]and, in particular, with ( |9^ . function h{t) is 


h{t) = < 


/(8 + f ) 
t - 12 
t - 5 


f-5.5 


/(4 + f)+4 


Vf : x°{t) = 8 

yt < 19.5 : x°{t) ^ {4, 8} 12 < f < 16) 

Vf G [19.5, 21.3) : x°(f) ^ {4,8} 19.5 < f < 21) 

Vf > 21.3 : a;°(f) ^ {4,8} 28 < f < 32) 

Vf : x°{t) = 4: 
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4.8 Example 8 

Consider the following functions f{x) and g{x) (depicted in the same graphic). 



Algorithm[T]provides toi = +oo, uj 2 = +oo, and = 18.83. Then, by applying lemma [T] (taking into account 
f(x + t), instead of f{x), and g{x)) the following function x°{t) is obtained. 


x°{i) 


with 


Xs{t) t < 18.83 
Xeit) t > 18.83 


[12 t<8 

Xs(t) = < —t + 20 8 < f < 16 

I 4 16 < < < 18.83 


Xe{t) 


12 18.83 < f < 26 

-t + 38 26 < f < 34 
4 f > 34 


Note that, T = {18.83}, that is, t* = 18.83, and Q = 1. The mapping function provides Z(l) = 3. Moreover, 
t* > 7 ai — a;i = 16 (then, Xs{t) has the structure of (fSal i) and t* < 704 — a ;2 = 26 (then, Xe{t) has the structure 
of (TTatl. The graphical representation of x°{t) is the following. 



Figure 34; Example 8 - Functions x°{t). 

By applying lemma|2]the following function h{t) = f{x°{t) + f) + g{x°{t)') is obtained. 
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Figure 35: Example 8 - Function h{t) = + t) + p(a:°(i)). 


In accordance with lemmal^and, in particular, with ( l9b] ). function h{t) is 


h{t) 


/(12 + f ) 
t-8 
t-9.5 
f(4 + t)+8 


Vt : x°{t) = 12 
'it < 18.83 : x°{t) ^ {4,12} 
it > 18.83 : x°{t) ^ {4,12} 
it : x°{t) = 4 


8 < t < 16) 
26 < f < 34) 
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4.9 Example 9 

Consider the following functions f{x) and g{x) (depicted in the same graphic). 



Algorithm [T] provides toi = 18, W 2 = +oo, and W 3 = 18.4 (the application of algorithm [T] is reported in the 
following, for each value of j). Then, by applying lemma [T] (taking into account f{x + t), instead of f{x), and 
g{x)) the following function x°{t) is obtained. 


x°{t) = 


with 


Xs{t) = 


Xs{t) f < 18 

xi{t) 18 < f < 18.4 
Xe(t) t > 18.4 


12 f < 4 

-f + 16 4 < f < 12 
4 12 < < < 18 


Xi{t)=—t + 25 Xe{t) 


12 18.4 < < < 26 

-f + 38 26 < < < 34 
4 f > 34 


Note that, T = {18,18.4}, that is, t* = 18 and = 18.4, and Q = 2. The mapping function provides Z(l) = 1 
and l{2) = 3. Moreover, > 701 — xi = 12 (then, Xs{t) has the structure of (l5alll. — 2:2 = 13 and 

^2 ^ 7 o 2 — = 21 (then, a;i(f) has the structure of (l 6 dl ll. and < 704 — a ;2 = 26 (then, Xe{t) has the structure 
of (TTalll. The graphical representation of x°{t) is the following. 



By applying lemma|2]the following function h{t) = f{x°{t) + f) + g{x°{t)) is obtained. 
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Figure 38: Example 9 - Function h{t) = f{x°{t) + i) + p(a;°(i)). 


In accordance with lemmal^and, in particular, with ( l9cl i. function h{t) is 


' /(12 + f ) 
t-4 


h{t) = < 


t - 1 
f-5.75 


/(4 + t)+8 


Vf : x°{t) = 12 

Vf < 18 : a;°(f) {4,12} 4 < f < 12) 

Vf e [18,18.4) : x°{t) ^ (4,12} 18 < f < 18.4) 

Vf > 18.4 : a;°(f) ^ (4,12} 26 < f < 34) 

Vf : x°{t) = A 
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5 Application to the single machine scheduling 


Consider a single machine scheduling problem in which 1 job of class Pi and 2 jobs of class P 2 must be executed. 
The due dates, the marginal tardiness costs of jobs, the processing time bounds and the marginal deviation costs of 
jobs are the: 


No setup is required between the execution of jobs of different classes. The evolution of the system state can be 
represented by the following diagram. 


CTi 1 — 0.5 ddi i — 10 


/3i = l 

pt*™ = 1 = 4 


Oi2^i — 0.25 dd2^i — 12 
a2,2 = 0-75 dd2,2 = 20 


pt^r = 1 


/32 = 1 

ptT 


= 2 



Figure 39: State diagram in the case of two classes of jobs, where = 1 and N 2 = 2. 

The application of dynamic programming, in conjunction with the new lemmas, provides the following optimal 
control strategies. 


Stage 2 - State [1 112]^ 



In state [1 1 t 2 ]^ the unique job of class Pi has been completed; then the decision about the class of the next job to 
be executed is mandatory. The cost function to be minimized in this state, with respect to the (continuos) decision 
variable r only (which corresponds to the processing time 41 ^ 2 , 2 ), is 

(22,2 max{f2 + T - dd2a , 0} + /32 (pf2°™ “ '^) + '^ 1,2 (^s) 
that can be written as /(pf 2,2 + ^ 2 ) + g{pt 2 , 2 ) being 


f{pt2,2 + ^ 2 ) = 0.75 • max{pf2,2 + ^2 - 20 , 0} 

2-pf2,2 pf2,2G[l,2) 


the two functions illustrated in figure l40l 
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It is possible to apply lemma [T] (note that /(pt 2,2 + ^ 2 ) follows definition |2] and g{pt 2 ^ 2 ) follows definition O, 
which provides the optimal processing time 

2(^2) = arg min {/(pf2.2 + ^2) + 9ipt2,2)} = Xe{t2) 

’ Pt2,2 

i<pr2,2<2 

illustrated in figure 1411 being Xe{t 2 ) the function 
Xeit2) = 2 

pt 2 2 (^ 2 ) and Xe{t 2 ) are in accordance with (l4al i and (iTcl) . respectively. Note that, in this case, A = B = %, 
|24| = \B\ = 0, and then there is no need of executing algorithm[T] Taking into account the mandatory decision 
about the class of the next job to be executed; the optimal control strategies for this state are 

1^1 (1) 1) ^2) = 0 Vf2 <^2(1) 1) ^2) = 1 Vf2 

T°(l,l,f2) =pf2,2(f2) = 2 Vf2 


f pt2,2('t2) = r°(l, l,t2) 


2 - 
1 - 


t2 

—(> 


Figure 41: Optimal control strategy t°(1, 1, ^ 2 ) (service time) in state [1 112]^- 
The optimal cost-to-go 

= f{pt°2,2{i2) + t2) + g{ptl2ih)) 

illustrated in figure|42l is provided by lemma|2] 



Figure 42: Optimal cost-to-go Ji 1 (^ 2 ) in state [1 1 ^ 2 ]^- 


Stage 2 - State [0 2 t 2 ]^ 



In state [0 2 ^ 2 ]^ all jobs of class P 2 have been completed; then the decision about the class of the next job to be 
executed is mandatory. The cost function to be minimized in this state, with respect to the (continues) decision 
variable r only (which corresponds to the processing time pfi,i), is 

0:14 max{f2 + T - ddi^i , 0} -I- / 3 i - t ) + Ji,2{^'i) 
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that can be written as /(pii.i + ^2) + g{pti,i) being 
+ ^ 2 ) = 0.5 • max{pii_i - 10 , 0} 
n(nf \ - I 4-pii.i Pti,i e [1,4) 

the two functions illustrated in figure [43 



It is possible to apply lemma[T](note that ^ 2 ) follows definition|2]and g(pti^i) follows definition^, which 

provides the optimal processing time 

pt°i lih) = arg min {/(pfi,i + 12 ) + g{pti i)] = Xe{t 2 ) 

' pti,i 

illustrated in figure l44l being Xe{t 2 ) the function 


Xe{t2) = 4 


pti 1 (^ 2 ) and Xe{t 2 ) are in accordance with (l4al i and (iTcl) . respectively. Note that, in this case, A = ^, B = %, 
|A| = \B\ = 0, and then there is no need of executing algorithm[T] Taking into account the mandatory decision 
about the class of the next job to be executed; the optimal control strategies for this state are 

S°{0,2,t2) = l Vf2 S°{0,2,t2)=0 Vt2 

T°(0,2,f2) =pfia(f2) = 4 Vf2 


t P^i 1 (^ 2 ) = ■’■“(O, 2,t2) 


^2 
—> 


Figure 44; Optimal control strategy t°(0, 2, 12 ) (service time) in state [0 2 f 2 ]^- 
The optimal cost-to-go 

■^ 0 , 2 (^ 2 ) = f{ptl,l{t2) + t2) + g{ptli{t2)) 

illustrated in figure l45l is provided by lemma|2] 



Figure 45: Optimal cost-to-go Jq 2 (^ 2 ) in state [0 2 f 2 ]^- 
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Stage 1 - State [1 0 ti]^ 



In state [1 0 ti]^ the unique job of class Pi has been completed; then the decision about the class of the next job to 
be executed is mandatory. The cost function to be minimized in this state, with respect to the (continues) decision 
variable r only (which corresponds to the processing time pf 2 ,i), is 

q; 2 ,i max{fi + T - (id 2 ,i, 0} + (pf 2 °™ + >^ 1,1 (^ 2 ) 

that can be written as f{pt 2 .i + fi) + g{pt 2 ,i) being 

f{ph,i + ti) = 0.25 • max{pf2,i + fi - 12 , 0} + Ji°i(pf2,i + ^i) 


g(,pt 2 ,i) = 


2 — pt2,l pt2,l & [1, 2) 

0 pf2.i^[l,2) 

the two functions illustrated in figure |46] 





16 17 

Figure 47; Optimal control strategy t°(1, 0, ti) (service time) in state [1 0 fi]^. 

It is possible to apply lemma [T] (note that f{pt 2 .i + fi) follows definition |2] and (?(pt 2 ,i) follows definition^, 
which provides the optimal processing time 

(ti) = arg min {f{pt 2 ,i+ti) + g{pt 2 ,i)}=Xe{ti) 

Pt 2 ,l 

i<pr2,i<2 

illustrated in figure l47l being a;e(f^i) the function 

(2 < 16 
Xe{ti) = < —ti + 18 16 < ti < 17 

i 1 ti > 17 

pt 2 i(ti) and a;e(fi) are in accordance with (l4al) and (iTal l. respectively. Note that, in this case, A = {2}, |A| = 1, 
7 ai = 18; moreover, since B = (h and |i3| = 0, there is no need of executing algorithm [1] It is worth again 
remarking that, in the current state, the decision about the class of the next job to be executed is mandatory, since 
the unique job of class Pi has been completed. Then, 

= 0 Vfi = 1 Vfi 

(2 < 16 

T°{l,0,ti) =pt°2iiti) = I -fi + 18 16<fi<17 

1 1 fi > 17 
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The optimal cost-to-go 

'^r,o(^i) = + h) + g{ptli{ti)) 

illustrated in figure|48l is provided by lemma|2] 



Figure 48: Optimal cost-to-go Ji giti) in state [1 0 

Stage 1 - State [0 1 ti]^ 



In state [0 1 ti]^, the cost function to be minimized, with respect to the (continues) decision variable t and to the 
(binary) decision variables (5i and S 2 is 

( 5 i [ai,i max{fi + t - ddi^i , 0} -F (pf™™ - r) -F ^^^(^2)] + 

-F 82 [0:2,2 max{ti -Ft - dd 2,2 , 0} -F /32 {ptT^ + -^0,2 (^2)] 



In this case, it is necessary to minimize, with respect to the (continues) decision variable t which corresponds to 
the processing time the following function 


oi,i maxjfi -F r - ddi^x , 0} -F - t) -F ^{’, 1 (^ 2 ) 

that can be written as /(pfi.i + fi) + g{pti,i) being 


fipti.i + ti) = 0.5 • max{pfi,i -F — 10,0} -F -F fi) 


g{pti,i) 


0 pfi,i^[l,4) 


the two functions illustrated in figure [49] 


It is possible to apply lemma [T] (note that /(pfi.i + fi) follows definition |2] and g{pti^i) follows definition O, 
which provides the function 


pt°i(ti)=arg min {f{pti^i+ti)+g{pti^i)}=Xe{ti) 

’ pti,i 


illustrated in figure l50l being a;e(ti) the function 


[4 fi < 14 

Xe{ti) = < —ti -F 18 14 < ti < 17 
1 1 ti > 17 
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14 17 

Figure 50: Function i(^i)- 


i(^i) Xe{ti) are in accordance with (l4al) and (fTal i. respectively. Note that, in this case, A = {2}, |A| = 1, 
jai = 18; moreover, since i? = 0 and \B\ = 0, there is no need of executing algorithm[T] 

The conditioned cost-to-go 

Jo.iiti I ^1 = 1) = +g{ptli{ti)) 

illustrated in figure|5T] is provided by lemma|2] 



Figure 51: Conditioned cost-to-go Jq | 5i = 1). 



In this case, it is necessary to minimize, with respect to the (continues) decision variable t which corresponds to 
the processing time pf 2 , 2 , the following function 

q; 2,2 max{fi -Ft - dd2a , + p2 (^^2°™ “ '^) + -^0,2(^2) 

that can be written as /(pf 2,2 + ti) + g{pt 2 , 2 ) being 

f{pt2.2 + ti)= 0.75 • max{pf2,2 -F — 20 , 0} -F Jo,2(f^ 2,2 + fi) 


g{pt2,2) 


2 — Pt2,2 Pt2,2 & [ 1 ) 2 ) 

0 pf2.2^[l,2) 
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the two functions illustrated in figure |52] 



It is possible to apply lemma [T] (note that f{pt 2,2 + ti) follows definition |2] and p(pf2,2) follows definition |3ll, 
which provides the function 

P^2 2(^i)=arg min {fipt2,2+ti)+g{pt2,2)}=Xe{ti) 

’ Pt2,2 

i<pr 2 , 2<2 

illustrated in figure l53l being Xe(fi) the function 

(2 < 18 
Xe(fi) = < —ti + 20 18 < fi < 19 
i 1 ti > 19 

P^2 2(^1) Xe{ti) are in accordance with (l4al) and (fTal i. respectively. Note that, in this case, A = {2}, = 1, 

7ai = 20; moreover, since B = % and \B\ = 0, there is no need of executing algorithm[T] 


f Pi2,2(ii) 


2 
1 

18 19 

Figure 53: Function2(^1)- 




The conditioned cost-to-go 

^0,l(fl I ^2 = 1) = f{pt2,2itl) +^l) + 9{pt2,2itl)) 

illustrated in figure|54l is provided by lemma|2] 



Figure 54: Conditioned cost-to-go Jq (fi | 62 = 1). 


In order to find the optimal cost-to-go Jg ^ (ti), it is necessary to carry out the following minimization 


'^o,i(^i) ~ {'^04(^1 I '^i “ 1)) '^04(^1 I ^2 — 1)} 
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which provides, in accordance with lemmaH] the function illustrated in figure l55] 



Since Joi(fi | <5i = 1) is the minimum in (—00,16) and Joi(fi | <^2 = 1) is the minimum in [16,+00), the 
optimal control strategies for this state are 


J?(0,l,ti) 


1 < 16 
0 fi > 16 




0 fi < 16 
1 ti > 16 


T°(0, l,fi) = 55’(0, l,fi)pfi i(fi) + ^ 2 ( 0 , l,fl)pf2,2(^l) 


illustrated in figure s l56ll57l and|58] respectively. 


'4 < 14 

-ti + 18 14 < fi < 16 
<2 16 < < 18 

-fi+20 18<fi<19 
1 + > 19 


1 - 1 ti 

-^-> 

16 

Figure 56: Optimal control strategy (5°(0,1, ti) in state [0 1 


1 - ;- tl 

- ^ - > 

16 

Figure 57: Optimal control strategy (52(0,1, ti) in state [0 1 



Figure 58: Optimal control strategy r°(0,1, ti) (service time) in state [0 1 ti]^. 
Stage 0 - State [0 0 to]^ (initial state) 



In state [0 0 to]^> the cost function to be minimized, with respect to the (continues) decision variable t and to the 
(binary) decision variables (5i and 62 is 

Si [ai,i max{fo + t - ddi^i , 0 } + / 3 i (pf™™ “ "r) + >^r.o(^i)] + 

+ S2 [a2,i max{fo + t- dd2s , 0 } + /32 - t) + >^0,1 (^1)] 
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Case i) in which it is assumed = 1 (and 62 = 0). 



In this case, it is necessary to minimize, with respect to the (continues) decision variable t which corresponds to 
the processing time the following function 

maxjfo + r - ddi^i , 0} + - r) + Jr,o(fi) 

that can be written as /(pfi,i + to) + dipti.i) being 


fiph.i + to) = 0.5 • max{pti,i + to - 10,0} + i(pti,i + to) 


g{pti,i) 


4-pti,i pti,ie[l,4) 

0 pti,i^[l,4) 


the two functions illustrated in figurel59l 



Figure 59: Functions f{pti^i + to) and 5(pti_i) in state [0 0 to]^. 


It is possible to apply lemma [T] (note that /(pti.i + to) follows definitionand ^(pti 1) follows definition [3]), 
which provides the function 

ptii(to) = arg min {/(pti.i + to) + p(pti4)} = a:e(to) 

pti.i 

i<pri,i<4 

illustrated in figurel^ being Xe{to) the function 


[4 ti < 12 

Xe{to) = 5 —ti + 16 12 < ti < 15 

1 1 ti > 15 


pt° i(to) and Xeido) are in accordance with (l4al) and (fTal i. respectively. Note that, in this case, A = {2}, |A| = 1, 
jai = 16; moreover, since B = % and \B\ = 0, there is no need of executing algorithm[T] 





12 15 

Figure 60: Function pt^* i(to). 


The conditioned cost-to-go 

'^0°o(^0 I = 1) = /(pt° ^(to) + to) + p(pt)’,i(to)) 
illustrated in figure]^ is provided by lemma|2] 
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Figure 61: Conditioned cost-to-go jQg(io | i5i = !)• 
Case ii) in which it is assumed 62 = ! (and i5i = 0). 



In this case, it is necessary to minimize, with respect to the (continues) decision variable t which corresponds to 
the processing time pt 2 ,i, the following function 

0:2,1 max{fo + T - dd2p , 0 } + /32 (^^2°™ “ '^) + >^0,1 (^1) 

that can be written as f{pt 2 .i + fo) + g{pt 2 ,i) being 

fiph,! + to) = 0.25 • max{p<2,i + fo - 12 , 0 } + Jopipt2,i + h) 


5(pi2.i) = ^ 


0 pf2.i^[l,2) 

the two functions illustrated in figure l62l 



It is possible to apply lemma [T] (note that f{pt 2 ,i + to) follows definition |2] and p(pf2,i) follows definition O, 
which provides the function 

ptl,{to) = arg min {/(pf2,i + to) + 9 {pt 2 p)} = { ^ 

l<pt2,l<2 

illustrated in figurein which 14.5 is the value oji determined by applying algorithm [T] and being Xs(to) and 
Xe{to) the functions 

(2 to <12 

x,(fo) = < -fo + 14 12 <fo <13 
I 1 13 < fo < 14.5 
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[ 2 14.5 < io < 16 

Xe(to) = % -to + 18 16 < io < 17 
i 1 to > 17 

pt 2 i(to)j Xs{to), and Xe{to) are in accordance with (l4bl) . (l5^ . and (iTal l. respectively. 

f Pi2,i(io) 



12 13 14.5 16 17 


Figure 63: Function i(to)- 

uji is determined by applying algorithm[T]as follows. 

A = {3,5} |A| =2 14 7a2 = 18 xi = 1 X 2 = 2 

B = {4} \B\ = 1 76, = 16 

With j = 1, the “Section A - Initialization” part of the algorithm provides: 


[row 1]: 

7 o = -oo 



[row 2]: 

h >0 : 76 < 16 - (2 - 1) < 7^+1 =1- 

h = 

3 

[row 3]: 

7 = 4 



[row 4]: 

77 = +00 



[row 5]: 

k <6 : 7fc < 16 + (2 - 1) < jk+i 

k = 

4 

[row 6]: 

condition: j = \B\ and |A| = \B\ (1 = 1 and 2 = 

1) is false 

[row 10]: 

f Pa = 1-25 - 1 = 0.25 
{ fl4 = 0.75-1 = -0.25 



[row 12]: 

T = 16- (2 - 1) = 15 



[row 13]: 

e = 16 



[row 14]: 

d = max{0, 0.25 ■ (16 - 15)} = 0.25 



[row 15]: 

condition: /i < — 1 (3 < 4 — 1) is false 



[row 20] : 

A = 3 



[row 21]: 

II 




Since condition: h < bi and i < a2 (4 < 5 and 3 < 4) [row 22] is true, the “Section B - First Loop” part of the 


algorithm is executed: 

[row 23] : 

ip = min{16 — 15,18 — 16} = 1 

[row 24]: 

condition: 76+1 — r < 77+1 — 9 (16 — 15 < 18 — 16) is true 

[row 25]: 

A = 3+1 = 4 

[row 27]: 

condition: 76+1 — r > 7^+1 — 9 (16 — 15 > 18 — 16) is false 

[row 30] : 

5 = max{0, -0.25 • [I8 - (15 + 1)] = 0 

[row 31]: 

condition: A < 6^ — 1 (3 < 4 — 1) is false 

[row 36]: 

condition: ^ = bj (4 = 4) is true 

[row 37]: 

,5 = 0- 0.25 • [(16 + 1) - 16] = -0.25 

[row 43]: 

condition: 5 < 0 (—0.25 < 0) is true 
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[row 44]: 

0 

II 

0 

[row 45]: 

r > 1 : Gr-i < 3 < Or =F r = 

[row 46]: 

condition: r < j (2 < 1) is false 

[row 68]: 

wi = 15 — 1 H-= 14.5 

0.25-F 0.25 

[row 69]: 

exit algorithm 


The conditioned cost-to-go 

I ^2 = 1) = + to) + g{pt 2 ^i{to)) 

illustrated in figure l64l is provided by lemma|2] 



Figure 64: Conditioned cost-to-go jQg(io | S 2 = !)■ 


In order to find the optimal cost-to-go Jg o(^o)j it is necessary to carry out the following minimization 

’^o,o(^o) = Olio {■^op(^o I 1^1 = 1) ) Jo.oi^o I 1^2 = 1)} 

which provides, in accordance with lemma|4l the function illustrated in figure l65] 



Figure 65: Optimal cost-to-go Jg o(fo) in state [0 0 fo]^- 


Since Jg g(to I <^1 = 1) is the minimum in (—00,15.3) and Jg g(fo I <^2 = 1) is the minimum in [15.3, -Foo), the 
optimal control strategies for this state are 


<5i°(0,0,fo) 


1 to < 15.3 
0 <0 > 15.3 


62(0,0, to) 


0 to < 15.3 
1 to > 15.3 


’(0,0, fo) = ^)’(0,0,fo)pf)’.i(fo) + 62 ( 0 , 0 , to)pt 2 i(to) = < 


4 

—to + 16 
2 
2 


—to + 18 
1 


to < 12 

12 < fg < 15_ 

15 £ fo < 15.3 
15.3 < fo < 16 

16 < to < 17 
to > 17 
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illustrated in figures|66l|^ and|68l respectively. 

j5f(0,0,to) 

1-. to 

--> 

15.3 

Figure 66: Optimal control strategy i5J(0, 0, to) in state [0 0 to]^- 

“52 (0,0, to) 

1 - I- to 

--> 

15.3 

Figure 67: Optimal control strategy i52(0, 0, to) in state [0 0 to]^- 


tr°(0,0,to) 



12 15;1617 


15.3 


Figure 68: Optimal control strategy t°(0, 0, to) (processing time) in state [0 0 to]^- 


Since the two conditional costs-to-go have the same value in the interval [10,13], the following functions represent 
alternative optimal control strategies for the considered state 


Si{0,0,to) = 


1 fo < 10 
0 10 < fo < 13 
1 13 < fo < 15.3 
0 fo > 15.3 


SU0,0,to) 


0 fo < 10 

1 10 < fo < 13 

0 13 < fo < 15.3 

1 to > 15.3 


r°(0,0,fi) 


4 

2 


Sl{0,0,to)ptl i{to) + (52(0,0,fo)Ff2,i(^o) = < 


-to + 14 
—to + 16 
1 
2 


—to + 18 
1 


to < 10 
10 < fo < 12 

12 < fo < 13 

13 < fo < 15 _ 

15 £ fo < 15.3 
15.3 < fo < 16 

16 < to < 17 
to > 17 


Such functions are illustrated in hgures|69]|7^ and|7T] respectively. 


“ 5?(0,0, to) 

1 -1 I-, to 

-^^-[> 

10 13 15.3 

Figure 69: Alternative optimal control strategy <51(0,0, to) in state [0 0 to]^. 


j 52°(0,0, to) 

1 - I-, I- to 

-^^- 1 > 

10 13 15.3 

Figure 70; Alternative optimal control strategy (5^(0,0, to) in state [0 0 to]^- 


jr°(0,0,to) 

4- 

2 - 
1 - 



to 
—£> 


15.3 

Figure 71: Alternative optimal control strategy t°( 0, 0, to) (service time) in state [0 0 to]^. 
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6 Application to the single machine scheduling - Example with setup 

Consider a single machine scheduling problem in which 4 jobs of class Pi and 3 jobs of class P 2 must be executed. 
The due dates, the marginal tardiness costs of jobs, the processing time bounds and the marginal deviation costs of 
jobs are: 


A setup is required between the execution of jobs of different classes. Setup times and costs are: 


The evolution of the system state can be represented by the following diagram. 


0 

il 

sfl,2 = 1 

st2.i = 0.5 

St2,2 = 0 


SC14 = 0 sci_2 = 0.5 
SC2,1 = 1 5C2,2 = 0 


0:2,1 = 2 
02,2 = 1 
02,3 = 1 


dd2^i = 21 
dd2^2 = 24 
dd 2 3 = 38 


pt^r 


P2 = 1.5 


= 4 = 6 


oi,i = 0.75 ddi^i = 19 
g:i^2 — 0.5 ddi^2 — 24 
oi^3 = 1.5 ddi^3 = 29 
oi,4 = 0.5 (idi,4 = 41 


= 4 


/3i = 1 

pf = 



Figure 72: State diagram in the case of two classes of jobs, where A^i = 4 and N 2 = 3, with setup. 


The 32 states (from SO to S'31) in the 7 stages are: 
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stage 0 

go [0 0 0 ^1^ 


stage 4 

gl3 

[4 0 1 uY' 

gl4 

[3 1 1 f4i'^ 

gl5 

[3 1 2 f4i'^ 

gl6 

[2 2 1 f4i'^ 

gl7 

[2 2 2 t4]'^ 

gl8 

[1 3 1 t4]'^ 

gl9 

[13 2 14]'^ 


stage 1 

51 [1 0 1 tiY' 

52 [0 12 tif 


stage 5 

g20 

[4 1 1 hV 

g21 

[4 1 2 

g22 

[3 2 1 

g23 

[3 2 2 

g24 

[2 3 1 

g25 

[2 3 2 


stage 2 

53 

[2 0 1 fa]" 

54 

[1 1 1 hf 

55 

[1 1 2 t2f 

56 

[0 2 2 t2f 


stage 6 

526 

[4 2 1 UY 

527 

[4 2 2 UY 

528 

[3 3 1 UY 

529 

[3 3 2 UY 


stage 3 

57 

[3 0 1 f3]" 

58 

[2 1 1 hY 

59 

[2 1 2 f3]^ 

510 

[1 2 1 f3]^ 

511 

[1 2 2 tYY 

512 

[0 3 2 



The application of dynamic programming, in conjunction with the new lemmas, provides the following optimal 
control strategies. 


Remark. In the following, the time variables tj, j = 0,... ,7, will be considered G K, that is, also negative values 
are taken into account. Negative values of tj can be considered when the strategies are determined in advance with 
respect to the initial time instant 0 at which the processing of the jobs starts. In this case, it is possible to exploit 
the optimal control strategies determined for the negative values of tj to start the execution of the jobs as soon as 
they become available, even before 0. 


Stage 7 - State [4 3 2 (531) 

No decision has to be taken in state [4 3 2 ^7]^. The optimal cost-to-go is obviously null, that is 

= 0 

Stage 7 - State [4 3 1 < 7 ]^ (530) 

No decision has to be taken in state [4 3 1 The optimal cost-to-go is obviously null, that is 
43.1 (^ 7 ) = 0 


Stage 6 - State [3 3 2 (529) 

In state [3 3 2 to]’^ all jobs of class P 2 have been completed; then the decision about the class of the next job to 
be executed is mandatory. The cost function to be minimized in this state, with respect to the (continues) decision 
variable r only (which corresponds to the processing time pfi,4), is 


maxjfe + 5^2,1 + r - , 0} -F /3i - t) + sc2,i + 543,1(^7) 

that can be written as /(pfi,4 + fe) + g{pti, 4 ) being 


/(pfi,4 + te) = 0.5 • max{pfi4 + tg — 40.5 , 0} -F 1 


g{pti,4) = 

The function 4(^5) 
lemma [T] It is 



-pti,4 pfi.4e[4,8) 
pfi,4 i [4,8) 

= argminptj -F fe) + g{pti,4)}^ 4 < pfi,4 < 8, is determined by applying 


pt°i, 4 {h) = Xe{tfi) with Xe{te) = 8 Vfe 


Taking into account the mandatory decision about the class of the next job to be executed, the optimal control 
strategies for this state are 

J“(3,3,2,f6) = 1 Vie (52°(3>3,2,f6) = 0 Vfg 
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Fundamental lemmas for the determination of optimal control strategies 
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T°(3,3,2,t6) = 8 Vtg 

The optimal control strategy r°(3,3, 2, ig) is illustrated in figure |7^ 

A r°(3, 3, 2 ,te) 


0 

Figure 73; Optimal control strategy t°( 3, 3, 2, ig) in state [3 3 2 ig]^. 


r> 


The optimal cost-to-go — fiptiAite) + te) + uipti illustrated in figure 17^ is provided by 

lemma |2] It is specified by the initial value 1, by the abscissa 71 = 32.5 at which the slope changes, and by the 
slope /ri = 0.5 in the interval [32.5, +00). 


0 

Figure 74; Optimal cost-to-go J^g 2(^6) in state [3 3 2 tg]^. 

Stage 6 - State [3 3 1 (5'28) 

In state [3 3 1 tg]^ all jobs of class P 2 have been completed; then the decision about the class of the next job to 
be executed is mandatory. The cost function to be minimized in this state, with respect to the (continues) decision 
variable r only (which corresponds to the processing time pfi,4), is 


q;i 7 maxjfg + sti^i + t - , 0} -F /3i - t) -F SC 17 -F ^437(^7) 


.nom 


that can be written as /(pfi,4 -F fg) -F 5(pfi,4) being 
f{pti,4 + te) = 0.5 • max{pti_4 -F fg - 41,0} 



The function 4(^5) = argmin^t^ 4{/(pfi,4 -F fg) -F p(pfi,4)}, with 4 < pfi,4 < 8, is determined by applying 
lemma [T] It is 

pti^ 4 {te) = Xeih) with Xe{te) = 8 Vfg 


Taking into account the mandatory decision about the class of the next job to be executed, the optimal control 
strategies for this state are 


5“(3,3,l,fg) = 1 Vfg <52°(3,3,l,fg) = 0 Vfg 


T°(3,3,l,fg) = 8 Vfg 

The optimal control strategy r°(3, 3,1, fg) is illustrated in figure iTSl 
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L 

^r°{3,3, Tts) 


^6 



Figure 76 ; Optimal cost-to-go Jg 3 i{te) in state [3 3 1 te]^- 


The optimal cost-to-go J^g = fiptl 4(^6) + te) + 9 {pti illustrated in figure l 76 l is provided by 

lemma| 2 ] It is specified by the initial value 0 , by the abscissa 71 = 33 at which the slope changes, and by the slope 
/ri = 0.5 in the interval [ 33 , -Foo). 

Stage 6 - State [4 2 2 te]^ (327) 

In state [4 2 2 all jobs of class Pi have been completed; then the decision about the class of the next job to 
be executed is mandatory. The cost function to be minimized in this state, with respect to the (continuos) decision 
variable r only (which corresponds to the processing time ^^2,3), is 

q; 2,3 maxjfg + 5^2,2 + r - dd 2,3 , 0 } -F /32 (ptr™ “ '^) + SC2,2 + -^4,3,2(^t) 

that can be written as f(pt2,3 + fg) + g{pt2,3) being 


f{pt2,3 + te) = max{pf2,3 -F fg - 38 , 0} 

. , ^ _ r 1.5 • (6 - pt2,3) pt2,3 G [4,6) 


The function 3(^5) = argminpt2,3{/(pf2,3 -F fg) + g{pt2,3)}, with 4 < pf2,3 < 6, is determined by applying 
lemma [T] It is 


pt°2,3{^&) = with a:e(fg) = 6 Vfg 


Taking into account the mandatory decision about the class of the next job to be executed, the optimal control 
strategies for this state are 

5“(4,2,2,fg) = 0 Vfg r5°(4,2,2,fg) = 1 Vfg 
T°(4,2,2,fg) = 6 Vfg 

The optimal control strategy r°( 4 , 2 , 2 , fg) is illustrated in figure iTTl 

The optimal cost-to-go JI2 3(^*6) “F “F g{pt2 3(^6))’ illustrated in figure l 78 l is provided by 

lemma| 2 | It is specified by the initial value 0 , by the abscissa 71 = 32 at which the slope changes, and by the slope 
/Ti = 1 in the interval [ 32 , -Foo). 
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Fundamental lemmas for the determination of optimal control strategies 
for a class of single machine family scheduling problems 


Ar°( 4 , 2 , 2 ,r 6 ) 


te 


Figure 77: Optimal control strategy t°(4, 2, 2, te) in state [4 2 2 



0 

Figure 78 : Optimal cost-to-go J4 2 2(^6) in state [4 2 2 tg]^- 


Stage 6 - State [4 2 1 tg]^ (S' 26 ) 

In state [4 2 1 tg]^ all jobs of class Pi have been completed; then the decision about the class of the next job to 
be executed is mandatory. The cost function to be minimized in this state, with respect to the (continuos) decision 
variable r only (which corresponds to the processing time ^^2,3), is 

0:2,3 maxjfg + sti ^2 + T - dd23 ,0 } + /32 - "t) + sci,2 + ^4,3,2(^r) 

that can be written as /(pf2,3 + to) + 9{pt2,3) being 


f{pt2,3 + te) = max{pf2,3 + fg - 37, 0} + 0.5 
f . J 1.5-(6-pf2.3) pt2.3e[4,6) 

= 1 0 Pt 2 . 3 ^[ 4 , 6 ) 

The function pf2,3(^6) = argmin^t^ 3{/(pt2,3 + te) + g(pt2,3)}, with 4 < pf2,3 < 6, is determined by applying 
lemma [T] It is 


pt °2 3 (tfi)=Xe{tfl) with Xe{te) = 6 Vfg 


Taking into account the mandatory decision about the class of the next job to be executed, the optimal control 
strategies for this state are 


5?(4,2,l,fg) = 0 Vfg 52°(4,2,l,fg) = l Vfg 
r°(4,2,l,fg) = 6 Vfg 

The optimal control strategy r°( 4 , 2 , 1 , fg) is illustrated in figure l 79 l 


Ar°(4,2, pts) 


te 


Figure 79: Optimal control strategy t°( 4, 2,1, fg) in state [4 2 1 fg]"^. 
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The optimal cost-to-go J 4 2 1 (^ 6 ) = /(p ^2 3 (^ 6 ) + ^e) + gipt^ site)), illustrated in figure [ 8 OI is provided by 
lemma|2] It is specified by the initial value 0.5, by the abscissa 71 = 31 at which the slope changes, and by the 
slope /ri = 1 in the interval [31, + 00 ). 

Stage 5 - State [2 3 2 (5'25) 

In state [2 3 2 all jobs of class P 2 have been completed; then the decision about the class of the next job to 
be executed is mandatory. The cost function to be minimized in this state, with respect to the (continuos) decision 
variable r only (which corresponds to the processing time pti^s), is 

ai^s maxjfs + sf 2 ,i + t - ddi^s , 0 } + / 3 i (ptr™ “ "t) + sc 2 ,i + J^s^iite) 

that can be written as /(pfi.s + t^) + gipti^s) being 


fipti,3 + te) = 1-5 ■ max{pfi,3 + fg - 28.5 , 0} + 1 + + is + 0.5) 


gipti,s) 


8-pfi,3 pfi,3G[4,8) 

0 pfi,3^[4,8) 


The function 3 (f 5 ) = argmin^t^ 3 {/(pfi _3 + fg) + gipti^s)}, with 4 < pti^s < 8 , is determined by applying 
lemma[T] It is 


[8 is < 20.5 

pti sih) = Xeih) with a;e(f 5 ) = < —fg + 28.5 20.5 < fg < 24.5 

1 4 fg > 24.5 


Taking into account the mandatory decision about the class of the next job to be executed, the optimal control 
strategies for this state are 

5?(2,3,2,i5) = 1 Vis <j2°(2,3,2,i5) = 0 Vig 

f 8 ig < 20.5 

T°(2,3,2,is) = <^ -i 5 + 28.5 20.5 < ig < 24.5 

[4 ig > 24.5 

The optimal control strategy r°(2, 3, 2 , ig) is illustrated in figure ISTI 


Ar°(2,3,2,t5) 



*5 


Figure 81; Optimal control strategy t°( 2, 3, 2, ig) in state [2 3 2 ig]^. 
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0 

Figure 82: Optimal cost-to-go J 2 3 2 (^ 5 ) in state [2 3 2 . 


The optimal cost-to-go ^ 232 (^ 5 ) = + PiP^i 3 (^ 5 ))’ illustrated in figure (821 is provided by 

lemma|2l It is specified by the initial value 1, by the set { 20.5, 24.5, 28.5 } of abscissae 7 ^, * = 1,..., 3, at which 
the slope changes, and by the set { 1, 1.5, 2 } of slopes z = 1,..., 3, in the various intervals. 

Stage 5 - State [2 3 1 (524) 

In state [2 3 1 all jobs of class P 2 have been completed; then the decision about the class of the next job to 
be executed is mandatory. The cost function to be minimized in this state, with respect to the (continuos) decision 
variable r only (which corresponds to the processing time is 

0:73 maxjfs -f sfia + t - ddi^s , 0} -F (ptr™ “ '^) + sci,! -F 

that can be written as /(pfi.s + t^) -F being 


f{ph,3 + fs) = 1-5 ■ max{pti,3 -F is - 29 ,0} -F + h) 


g{pti,3) 


8-pfi,3 pfi,3G[4,8) 

0 pfi,3^[4,8) 


The function 3 (is) = argmin^t^ 3 {/(pfi _3 4 -^ 5 )+ g{pti^ 3 )}, with 4 < pti^^ < 8, is determined by applying 

lemma (Tj It is 

(8 ts < 21 

pti 3 (^ 5 ) = with a;e(f5) = < — f 5 -F 29 21 < fs < 25 

1 4 ts > 25 


Taking into account the mandatory decision about the class of the next job to be executed, the optimal control 
strategies for this state are 

5?(2,3,l,f5) = 1 Vis <)2°(2,3,l,f5) = 0 Vfs 

(8 ts < 21 

T°(2,3,l,t5) = < -t5 + 29 21 <t5<25 
[4 ts > 25 

The optimal control strategy r°(2, 3,1, ts) is illustrated in figure [83] 


Ar°(2,3,l,t5) 



*5 


Figure 83: Optimal control strategy t°( 2, 3,1, ts) in state [2 3 1 ts]^. 
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Fundamental lemmas for the determination of optimal control strategies 
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The optimal cost-to-go J 2 3 1 (^ 5 ) = fiptl 3 (^ 5 ) + ^ 5 ) + gipti 3 (^ 5 )), illustrated in figure [84l is provided by 
lemma|2 It is specified by the initial value 0, by the set { 21, 25, 29 } of abscissae 7 ^, * = 1,..., 3, at which the 
slope changes, and by the set { 1, 1.5, 2 } of slopes pi, i = 1,..., 3, in the various intervals. 

Stage 5 - State [3 2 2 fg]^ (523) 

In state [3 2 2 the cost function to be minimized, with respect to the (continuos) decision variable r and to 
the (binary) decision variables and <52 is 

(5i [ai 4 max{f 5 + sf 2 .i + t - ddi^i , 0} + /3i - r) + sc 2 ,i + 5^,2.i(^6)] + 

+ S 2 [a2,3 max{t5 + 5 ^ 2,2 + t- dd2,z , 0} + /32 (ptr™ “ "t) + SC2,2 + -^ 3 , 3 . 2 (^e)] 


Case i) in which it is assumed = 1 (and 62 = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time the following function 


maxjfs + 5^2,1 + r - , 0 } + - t) + sc 2 ,i + J42,i(^6) 

that can be written as f{pti ,4 + fg) + g{pti^ 4 ) being 


fiptl ,4 + fs) = 0.5 • max{pti 7 + fg — 40.5 , 0} + 1 + 5^,2.i(P^i,4 + fs + 0.5) 


gipti,4) 


8-pfi,4 pfi,4e[4,8) 

0 pfi,4^[4,8) 


The function 4 (^ 5 ) = argmin^t^ 4 {/(pfi ,4 + fs) + p(pfi, 4 )}, with 4 < pfi ,4 < 8 , is determined by applying 
lemma[T] It is (see figure IHSTl 


[8 is < 22.5 

pfi 4 (^ 5 ) = a;e(f 5 ) with a;e(f 5 ) = < —fg + 30.5 22.5 < tg < 26.5 

I 4 is > 26.5 


1 , 4 ^ 5 ) 





Figure 85; Optimal processing time pt^ 4 (^ 5 ), under the assumption (5i = 1 in state [3 2 2 < 5 ]^. 

The conditioned cost-to-go J^^ 2 , 2 i^^ | <5i = 1) = fiptf 4 it 5 ) + tf) -\- gipt\^ 4 itf)), illusttated in figure [87] is 
provided by lemma|2] It is specified by the initial value 1.5, by the set { 22.5, 36.5 } of abscissae 7 ^, i = 1,..., 2, 
at which the slope changes, and by the set { 1, 1.5 } of slopes pi, i = 1,..., 2, in the various intervals. 
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Case ii) in which it is assumed ^2 = 1 (and i5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time the following function 


^ 2,3 maxjfs + sf 2,2 + T- dd2,3 , 0} + ^2 (^^2°“ “'t) + SC2.2 + -^3.3.2(^e) 
that can be written as /(pf2,3 + ^5) + 9 {pt 2 , 3 ) being 


f{pt2,3 + fs) = max{pf2,3 + is - 38, 0} + J3,3,2(pi2,3 + h) 


g{pt2,3) 


1.5 • (6-pf2,3) pt2.3G[4,6) 
0 pt 2,3 ^ [4,6) 


The function 3(^5) = argmin^t^ 3{/(pf2,3 + ^5) + 9 {pt 2 , 3 )}, with 4 < pf2,3 < 6, is determined by applying 
lemma[T] It is (see figure [86ll 


I 6 fs < 32 

pt 2 sih) = Xeit5) with a:e(f5) = < -fs + 38 32 < fs < 34 

I 4 ts > 34 


APt2.3(t5) 


\ 


^5 


Figure 86 : Optimal processing time pf^ 3 (^ 5 ), under the assumption ^2 = 1 in state [3 2 2 

The conditioned cost-to-go JI 2 2(^5 I <^2 = 1) = f(,pt 2 3 (^ 5 ) + ^s) + 9 {pt 2 3 (^ 5 ))’ illustrated in figure l87l is 
provided by lemma|2] It is specihed by the initial value 1, by the set { 26.5, 32 } of abscissae 7 ^, i = 1,..., 2, at 
which the slope changes, and by the set { 0.5, 1.5 } of slopes i = 1,..., 2, in the various intervals. 


Figure 87: 



In order to find the optimal cost-to-go J 3 2 2 (^ 5 )’ 1^ is necessary to carry out the following minimization 

"^3, 2 , 2 (^ 5 ) = min {t/3_2,2(^5 I = 1) j '^ 3 , 2 , 2(^5 I ^2 = 1)} 

which provides, in accordance with lemmalU the continuous, nondecreasing, piecewise linear function illustrated 
in figure [88l 

The function J ^2 2 (^ 5 ) 1^ specified by the initial value 1, by the set { 26.5, 32 } of abscissae 7^,1 = 1,..., 2, at 
which the slope changes, and by the set { 0.5, 1.5 } of slopes /x^, i = 1,..., 2, in the various intervals. 

Since J 3 2 2(^5 I <^2 = 1) is always the minimum (see again figure [87]). the optimal control strategies for this state 
are 


5?(3,2,2,f5) = 0 Vis <52“(3,2,2,f5) = 1 Vfs 
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0 


Figure 88; Optimal cost-to-go J ^2 2 (^ 5 ) [3 2 2 

r 6 ^5 < 32 

T°{3,2,2,t5) = I -^5 + 38 32 <t5<34 
[4 is > 34 

The optimal control strategy r°(3, 2, 2, is) is illustrated in figure |89] 

AT°(3,2,2,r5) 

\ 


Figure 89; Optimal control strategy t°( 3, 2, 2, is) in state [3 2 2 is]^- 

Stage 5 - State [3 2 1 (S'22) 

In state [3 2 1 is]^, the cost function to be minimized, with respect to the (continuos) decision variable r and to 
the (binary) decision variables Si and S 2 is 


(5i [q!i, 4 max{is + sii,i + r - ddi^4 , 0} + /3i (pii°™ -''")+ sci,i + ^4,2,1 (^6)] + 
+ S2 [a2,3 max{is + sii,2 + t- dd 2,3 , + P2 - t ) + sci^2 + 


Case i) in which it is assumed 5i = 1 (and 82 = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time the following function 


ai ^4 maxjfs + sfi,i + r - , 0} + -''") + sci,i + Jl^ 2 .i{h) 

that can be written as /(pfi,4 + fs) + 5(p^i,4) being 


fiptiA + is) = 0.5 • max{pfi_4 + is - 41,0} + J4,2,i(pii.4 + h) 


g{ptiA) 


8-pfi.4 pfi.4e[4,8) 

0 pfi,4^[4,8) 


The function 4 (^ 5 ) = argmin^t^ 4 {/(pfi ,4 + fs) + diptiA)}’ 4 < pfi ,4 < 8 , is determined by applying 
lemma[T] It is (see figure l90ll 


I 8 fg < 23 

pti 4 {h) = Xe{h) with a;e(f5) = < -fs + 31 23 < fg < 27 

I 4 fg > 27 
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Apr?,4(^5) 



h 


Figure 90; Optimal processing time pt^ 4 (^ 5 ), under the assumption (5i = 1 in state [3 2 1 ^ 5 ]^. 


The conditioned cost-to-go J 3 ^ 2 ,i (^5 I <^1 = 1) = f{pti, 4 {t 5 ) + ^s) + ff(P^i, 4 (^ 5 ))’ illustrated in figure l9^ is 
provided by lemma|2] It is specified by the initial value 0.5, by the set { 23, 37 } of abscissae 7 ^, * = 1,..., 2, at 
which the slope changes, and by the set { 1, 1.5 } of slopes /i^, i = 1,..., 2, in the various intervals. 

Case ii) in which it is assumed ^2 = 1 (and (5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time pf 2 , 3 , the following function 

a2,3 max{f5 + sti^ + r - dd2.3 , 0} + /32 (pf™™ - t) + sci.2 + '/3.3.2(^6) 

that can be written as /(pf 2,3 + fs) + 9 {pt 2 , 3 ) being 


f{pt2,3 + h) = max{pf2,3 + is - 37, 0} + 0.5 + J3°3,2(pf2,3 + ts + 1) 


9{pt2,3) 


1.5 • ( 6 -pf2,3) pf2,3€[4,6) 

0 pt2,3^[4,6) 


The function pf 2 , 3 (^ 5 ) = 9 'rgminpt 2 , 3 {/(pi 2,3 + fs) + 5 (pf 2 , 3 )}, with 4 < pf 2,3 < 6 , is determined by applying 
lemma[T] It is (see figure lOTTl 


16 t5 < 31 

P^2,3(^5) = tCe(f5) with a:e(f5)=< “fs + 37 31 < fs < 33 

[4 ts > 33 

\_ 


Figure 91; Optimal processing time pt^ 3 (^ 5 ), under the assumption 52 = 1 in state [3 2 1 < 5 ]^. 

The conditioned cost-to-go JI 2 1(^5 | ^2 = 1) = /(pf 2 3 (^ 5 ) + ^ 5 ) + s(P ^2 3 (^ 5 ))’ illustrated in figure l9^ is 
provided by lemma|2] It is specified by the initial value 1.5, by the set { 25.5, 31 } of abscissae 7 ^, i = 1,..., 2, at 
which the slope changes, and by the set { 0.5, 1.5 } of slopes pi, i = 1,..., 2, in the various intervals. 
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In order to find the optimal cost-to-go Jg 2 1 (f 5 ), it is necessary to carry out the following minimization 

"^ 3 ,24(^5) = min {-/g^2,1(^5 I <^1 = 1 ) j >^ 3 . 2 ,1(^5 I ^2 = 1 )} 

which provides, in accordance with lemma]?] the continuous, nondecreasing, piecewise linear function illustrated 
in hgurel93] 



The function Jg 2 1 (^ 5 ) is specihed by the initial value 0.5, by the set { 23, 24, 25.5, 31 } of abscissae 7 ^, i = 
1,..., 4 , at which the slope changes, and by the set { 1, 0, 0.5, 1.5 } of slopes Hi, i = 1,. .., 4, in the various 
intervals. 

Since JI 2 1(^5 I <^1 = 1) is the minimum in (— 00 , 24), and Jg 2 1(^5 | ^2 = 1) is the minimum in [24, + 00 ), the 
optimal control strategies for this state are 


5?(3,2,l,f5) 


1 f 5 < 24 
0 fs > 24 


^°(3,2,l,f5) 


0 is < 24 
1 fg > 24 


T°(3,2,l,f5) 


' 8 

—fg + 31 
< 6 


—fg + 37 
4 


fg < 23 

23 < fg < 24 

24 < fg < 31 
31 < fg < 33 
tg > 33 


The optimal control strategy r°(3, 2,1, fg) is illustrated in hgurel94l 


Ar°(3,2, 1 ,( 5 ) 

-s 

-\ 


t5 

- 0 -^ 

Figure 94; Optimal control strategy t°( 3, 2,1, fg) in state [3 2 1 fg]^. 

Stage 5 - State [4 1 2 (5'21) 

In state [4 12 fg]^ all jobs of class Pi have been completed; then the decision about the class of the next job to 
be executed is mandatory. The cost function to be minimized in this state, with respect to the (continues) decision 
variable r only (which corresponds to the processing time ^^ 2 , 2 ), is 

q; 2,2 maxjfg + 5 ^ 2.2 + r - ((^ 2,2 , 0} + /32 + ^^ 2,2 + JI, 2 , 2 {^q) 

that can be written as f{pt 2.2 + fs) + g{pt 2 , 2 ) being 

f{pt2,2 + h) = ma.x{pt2,2 + fg - 24 , 0} + J4,2,2(P^2,2 + h) 
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9{pt2,2) = 


1.5 • ( 6 -pi 2 , 2 ) pt2,2G[4,6) 
0 pt2,2 ^ [4, 6 ) 


The function 2(^5) = a'rgminpt2,2{/(pi2,2 + ^5) + g{pt 2 , 2 )}, with 4 < pf2,2 < 6, is determined by applying 
lemma[T] It is 

6 fs < 26 

pt 2 , 2 ih) = Xeih) with Xe{t5) = -fs + 32 26 < f5 < 28 

1 f-s ^ 28 


Taking into account the mandatory decision about the class of the next job to be executed, the optimal control 
strategies for this state are 

5?(4,l,2,f5) = 0 Vis <52°(4,l,2,f5) = 1 Vfs 
f 6 fs < 26 

t°( 4, l,2,f5) = <^ -f5 + 32 26 <f5<28 

4 ^5 ^ 28 

The optimal control strategy t°(4, 1, 2, t^) is illustrated in figure l95] 

Ar°(4,l,2,t5) 

\_ 

h 


Figure 95; Optimal control strategy t°(4, 1, 2, t^) in state [4 12 

The optimal cost-to-go ^ 2 (^ 5 ) = /(f ^2 2 (^ 5 ) + ^ 5 ) + 9 {pt2 2 (^ 5 ))’ illustrated in figure [96] is provided by 
lemma|2] It is specified by the initial value 0, by the set { 18, 26, 28 } of abscissae 7 ^, * = 1,..., 3, at which the 
slope changes, and by the set { 1, 1.5, 2 } of slopes pi, i = 1,..., 3, in the various intervals. 



Figure 96: Optimal cost-to-go J| i 2 (^ 5 ) [4 12 fs]^. 

Stage 5 - State [4 1 1 fs]^ (S'20) 

In state [4 11 all jobs of class Pi have been completed; then the decision about the class of the next job to 
be executed is mandatory. The cost function to be minimized in this state, with respect to the (continues) decision 
variable r only (which corresponds to the processing time ^^ 2 , 2 ), is 

0 : 2,2 maxjfs -I- sti ^2 + T - dd 2 a , 0} -F ,82 (^^ 2 °™ + ' 5 Ci ,2 + Jl^ 2 , 2 {h) 

that can be written as /(pf 2,2 + tb) + g{pt 2 , 2 ) being 

f{pt2.2 + tb) = max{pf2,2 + is - 23 , 0} -F 0.5 -F 8{’2,2(pt2,2 + h + l) 
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9{pt2,2) = 


1.5 • (6-pi2,2) pt2,2G[4,6) 
0 pt2,2 ^ [4,6) 


The function 2(^5) = a'rgminpt2,2{/(pi2,2 + ^5) + g{pt2,2)}, with 4 < pf2,2 < 6, is determined by applying 
lemma[T] It is 

6 fs < 25 

pt2,2ih) = Xeih) with Xe{t5) = -fs + 31 25 < ^5 < 27 

1 ^5 ^ 27 


Taking into account the mandatory decision about the class of the next job to be executed, the optimal control 
strategies for this state are 

5?(4,l,l,f5) = 0 Vis <52°(4,l,l,f5) = l Vfs 
(6 fs < 25 

T°(4,l,l,f5) = < -f5 + 31 25<h<27 
[4 ts > 27 

The optimal control strategy t°(4, 1,1, t^) is illustrated in figure l97] 

Ar°(4,l,l,t5) 

\_ 

h 


Figure 97; Optimal control strategy t°(4, 1,1, t^) in state [4 11 

The optimal cost-to-go ^ 1 (^ 5 ) = f{pt 2 2 (^ 5 ) + ^ 5 ) + 9 {pt2 2 (^ 5 ))’ illustrated in figure [98] is provided by 
lemma|2] It is specified by the initial value 0.5, by the set { 17, 25, 27 } of abscissae 7 ^, I = 1,..., 3, at which the 
slope changes, and by the set { 1, 1.5, 2 } of slopes pi, i = 1,..., 3, in the various intervals. 



Figure 98: Optimal cost-to-go J| i 1 (^ 5 ) in state [4 11 fs]^. 

Stage 4 - State [13 2 * 4 ]^ (S'19) 

In state [13 2 14 ]'^ all jobs of class P 2 have been completed; then the decision about the class of the next job to 
be executed is mandatory. The cost function to be minimized in this state, with respect to the (continues) decision 
variable r only (which corresponds to the processing time pfi, 2 ), is 

ai^2 max{f4 -(- sf2,i + t - , 0} -F - t) + sc2,i + J2,3,i{t5) 

that can be written as /(pfi ,2 + ti) + g{pti, 2 ) being 

f{pti .2 + ^ 4 ) = 0.5 • max{pfi,2 + t 4 - 23.5 , 0} -F 1 -F J2,3.i(P^i.2 + ^4 + 0.5) 
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g{pti,2) 


8 -pii ,2 pii.2e[4,8) 

0 pti,2^[4,8) 


The function 2 (^ 4 ) = argminptj 2 {/(pfi ^2 + ^ 4 ) + g{pti. 2 )}, with 4 < pti ^2 < 8 , is determined by applying 
lemma[T] It is 


[8 t4< 12.5 

pti 2 {ti) = Xeiti) with a:e(f 4 ) = < —f 4 + 20.5 12.5 < ^4 < 16.5 

I 4 t4> 16.5 


Taking into account the mandatory decision about the class of the next job to be executed, the optimal control 
strategies for this state are 

5°(l,3,2,f4) = 1 Vf4 (52(l,3,2,f4) = 0 Vf4 

f 8 t4< 12.5 

T°(l,3,2,f4) = < -f4 + 20.5 12.5 <f4< 16.5 

[4 t4> 16.5 

The optimal control strategy r°(l, 3, 2, ^ 4 ) is illustrated in figure l99] 


AT°(l,3,2,i4) 



t4 


Figure 99; Optimal control strategy t°(1, 3, 2, ^ 4 ) in state [13 2 ^ 4 ]^. 

The optimal cost-to-go Jj ’3 2 (^ 4 ) = f{pti 2 (^ 4 ) + ^ 4 ) + gipti 2 (^ 4 ))’ illustrated in figure fTOOl is provided by 
lemma|2] It is specified by the initial value 1, by the set { 12.5, 19.5, 20.5, 24.5 } of abscissae 7 ^, i = 1,..., 4, at 
which the slope changes, and by the set { 1, 1.5, 2, 2.5 } of slopes 1,.. ., 4, in the various intervals. 



0 

Figure 100: Optimal cost-to-go J °3 2 (^ 4 ) in state [13 2 ^ 4 ]^. 


Stage 4 - State [13 1 * 4 ]^ (S'lS) 

In state [13 1 f 4 ]^ all jobs of class P 2 have been completed; then the decision about the class of the next job to 
be executed is mandatory. The cost function to be minimized in this state, with respect to the (continues) decision 
variable r only (which corresponds to the processing time pfi, 2 ), is 

ai^2 max{f4 -(- sfij + t - ddi^2 , 0 } -F - t) + SC 17 -F 

that can be written as /(pfi ,2 + ti) + g{pti, 2 ) being 

f{pti.2 + ^ 4 ) = 0.5 • max{pfi,2 -F f4 - 24,0} -F J2,3,i{pti,2 + ^ 4 ) 
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g{pti,2) 


8 -pii ,2 pii.2e[4,8) 

0 pti,2^[4,8) 


The function 2 (^ 4 ) = aigminpt^ 2 {f{pti ,2 + ti) + g{pti, 2 )}, with 4 < pti ^2 < 8 , is determined by applying 
lemma[T] It is 


P^1,2(^4) = Xe{ti) 


with 


Xe{tA) = 


8 t4 < 13 

-<4 + 21 13 < f4 < 17 
4 f4 > 17 


Taking into account the mandatory decision about the class of the next job to be executed, the optimal control 
strategies for this state are 

5°(l,3,l,f4) = 1 Vf4 (52(l,3,l,f4) = 0 Vf4 
f 8 f4 < 13 

T°(l,3,l,f4) = < -f4 + 21 13 < <4 <17 

[4 f4 > 17 

The optimal control strategy r°(l, 3,1, ^ 4 ) is illustrated in figure fToTI 


Ar°{l,3, l,r4) 



ti 


Figure 101; Optimal control strategy t °(1, 3,1, t^) in state [13 1 14]^. 


The optimal cost-to-go Jfg 4 (^ 4 ) = f{ptl 2 (^ 4 ) + ^ 4 ) + giP^i 2 (^ 4 ))’ illustrated in figure [T02l is provided by 
lemma|2] It is specified by the initial value 0, by the set { 13, 20, 21, 25 } of abscissae ^i, i = 1,..., 4, at which 
the slope changes, and by the set { 1, 1.5, 2, 2.5 } of slopes i = 1,..., 4, in the various intervals. 



Stage 4 - State [2 2 2 * 4 ]^ (517) 

In state [2 2 2 14 ]^, the cost function to be minimized, with respect to the (continues) decision variable t and to 
the (binary) decision variables (5i and 82 is 

Si [ai ,3 max{f 4 + sf2,i + t - ddi^s , 0 } + / 3 i (ptr™ “ "r) + 5^2,1 + +3,2,1 (^5)] + 

+ S 2 [a2,3 max{f 4 + sf2,2 + t- +^2,3 , 0} + ^2 (^^2°“ “'t) + SC2,2 + +2,3.2 fe)] 

Case i) in which it is assumed i5i = 1 (and 82 = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time pfi, 3 , the following function 

q;i ,3 max{f 4 + 5^2,1 + r - +1(1,3 , 0 } + / 3 i (pfi°“ - t) + sc2,i + +3,2,1 ((5) 
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that can be written as /(pii.s + ^ 4 ) + gipti^s) being 


+ ^ 4 ) = 1-5 • max{pti_3 + i4 — 28.5 , 0} + 1 + ^3,2,i(P^i,3 + ^4 + 0.5) 


9{pti,3) 


8-pii.3 pii.3G[4,8) 

0 pti,3^[4,8) 


The function 3 (^ 4 ) = argminptj 3 {/(pfi ^3 + t 4 ) + g{pti^ 3 )}, with 4 < pti^s < 8 , is determined by applying 
lemma[T] It is (see figure flOTt 


P^1,3(^4) 


a;s(f4) t 4 < 15.5 
a;e(f4) ^4 > 15.5 


with a;s(< 4 ) = 


8 f 4 < 14.5 

-f 4 + 22.5 14.5 <f 4 < 15.5 ’ 


and Xe{t 4 ) 


8 15.5 < f 4 < 20.5 

-t 4 + 28.5 20.5 < f 4 < 24.5 
4 t 4 > 24.5 





ti 


Figure 103; Optimal processing time pt^ 3 (^ 4 ), under the assumption = 1 in state [2 2 2 ^ 4 ]^. 


The conditioned cost-to-go J 22 2(^4 I ^1 = 1) = f{pti 3 (^ 4 ) + ^ 4 ) + g{pti 3 (^ 4 )), illustrated in figure [T05l is 
provided by lemma |2 It is specified by the initial value 1.5, by the set { 14.5, 15.5, 17, 20.5, 24.5, 26.5 } of 
abscissae 7 ^, i = 1,..., 6 , at which the slope changes, and by the set { 1, 0, 0.5, 1, 2, 3 } of slopes pi, i = 1,... ,6, 
in the various intervals. 

Case ii) in which it is assumed ^2 = 1 (and (5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time pf 2 , 3 , the following function 

q; 2.3 max{f4 + sf2,2 + r - dd 2,3 , 0} + /32 (pf™™ - f) + SC2,2 + -173,2(^5) 

that can be written as /(pf 2,3 + I 4 ) + g{pt 2 , 3 ) being 

f{pt 2,3 + U) = max{pf2,3 + f 4 - 38 , 0} + J2,3,2(p^2,3 + U) 


g{pt2,3) 


1.5 • ( 6 -pf2.3) pf2.3e[4,6) 
0 pt 2,3 ^ [4, 6 ) 


The function pf 2 , 3 (^ 4 ) = argmiupt^ 3 {/(pf 2,3 + ti) + g{pt 2 , 3 )}, with 4 < pf 2,3 < 6 , is determined by applying 
lemma[T] It is (see figure [T04l l 


[6 t 4 < 18.5 

Pt2,3{t4) = Xe(t4) with = < —^4 + 24.5 18.5 < O < 20.5 

[4 f4 > 20.5 

The conditioned cost-to-go J 22 2(^4 I <^2 = 1) = /(p^^ 3 (^ 4 ) + ^ 4 ) + P(P ^2 3 (^ 4 ))’ illustrated in figure [T05l is 
provided by lemma |2] It is specified by the initial value 1, by the set { 14.5, 18.5, 24.5, 34 } of abscissae 7 ^, 
i = 1,..., 4, at which the slope changes, and by the set { 1, 1.5, 2, 3 } of slopes pi, i = 1,..., 4, in the various 
intervals. 

In order to find the optimal cost-to-go J2 2 2(^4)’ necessary to carry out the following minimization 
'^2,2,2(^4) = Ulin {>/ 2 , 2 , 2(^4 I <^1 = 1 ) J '^2,2,2(^4 I ^2 = 1 )} 
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\ 


ti 


Figure 104; Optimal processing time 3 (^ 4 ), under the assumption ^2 = 1 in state [2 2 2 ^ 4 ]^. 



42,2. 2(^4 I ‘il ~ 1) 


Figure 105; Conditioned costs-to-go J 2 2 2(^4 I <^1 = 1) ^nd J 2 2 2(^4 I <^2 = 1) in state [2 2 2 tiY 



0 

Figure 106; Optimal cost-to-go J 22 2 (^ 4 ) in state [2 2 2 ^ 4 ]^. 


which provides, in accordance with lemma|4l the continuous, nondecreasing, piecewise linear function illustrated 
in figure [T06] 

The function J 22 2 (^ 4 ) i^ specified by the initial value 1, by the set { 14.5, 16, 17, 20.5, 24.5, 26.5, 32.25, 34 } 
of abscissae 7^,1 = 1,.. ., 8, at which the slope changes, and by the set { 1, 0, 0.5, 1, 2, 3, 2, 3 } of slopes pi, 
i = 1 ,..., 8, in the various intervals. 

Since J 2 2 2(^4 I — 1) i^ minimum in [16, 32.25), and J 2 2 2(^4 I <^2 = 1) is the minimum in (— 00 ,16) and 
in [32.25, + 00 ), the optimal control strategies for this state are 


[0 f4 < 16 

(5°(2,2,2, U) = \ 1 16 < f 4 < 32.25 
I 0 f 4 > 32.25 


[1 f4 < 16 

62 ( 2 , 2 , 2 , 14 ) = \ 0 16 <f 4 < 32.25 
I 1 f 4 > 32.25 


T°(2,2,2,f4) 


6 ^4 < 16 

8 16 < f 4 < 20.5 

-<4 + 28.5 20.5 <t 4 < 24.5 

4 f 4 > 24.5 


The optimal control strategy r°( 2 , 2 , 2 , ^ 4 ) is illustrated in figure [T07l 
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Ar°(2,2,2,t4) 



ti 

- 0 -^ 

Figure 107; Optimal control strategy r°(2, 2, 2, ^ 4 ) in state [2 2 2 t 4 ]^. 

Stage 4 - State [2 2 1 U]'^ (^IG) 

In state [2 2 1 ^ 4 ]^, the cost function to be minimized, with respect to the (continues) decision variable r and to 
the (binary) decision variables and 82 is 


(5i[q;i, 3 max{f4 + + r - ddi^s , 0} +/3i “ '^) + sci^i + (^ 5 )] + 

+ 82 [a2,3 max{t4 + sfi,2 + r - dd2,3 , 0} + /32 - t) + sci,2 + -^2°3,2fe)] 


Case i) in which it is assumed = 1 (and 82 = 0). 

In this case, it is necessary to minimize, with respect to the (continues) decision variable t which corresponds to 
the processing time pti, 3 , the following function 


q;i, 3 max{f4 + sti^i + r - ddi^s , 0} + /3i - t) + sci,i + J^^2,i{^^) 

that can be written as /(pfi ,3 + t^) + being 


/(pfi,3 + ti) = 1-5 • max{pti,3 + f4 - 29,0} + J^^2,i{pti,3, + U) 


9{pti,3) 


8-pfi,3 pfi,3G[4,8) 

0 pfi,3^[4,8) 


The function 3 (f 4 ) = argmin^t^ 3 {/(pfi _3 + ^ 4 ) + g{pti^ 3 )}, with 4 < pti^^ < 8 , is determined by applying 

lemma[T] It is (see hgure fTOSl) 


Ptl,3iti) 

_ f Xs(t4) 

\ XeiU) 

t4 < 16 
f4 > 16 

with Xs{t 4 ) 



8 

16 < f4 < 21 

and 

Xe{t4) = 5 

—^4 + 29 

21 < f4 < 25 


1 

4 

t4 > 25 






8 f4 < 15 

-f 4 + 23 15 < f 4 < 16 ’ 



U 


Figure 108: Optimal processing time pti 3 (^ 4 ), under the assumption = 1 in state [2 2 1 ^ 4 ]^. 

The conditioned cost-to-go J 22 i (^4 I ^1 = 1) = f{pti 3 (^ 4 ) + ^ 4 ) + 9 {pti 3 ( 0 )), illustrated in hgure fTTOl is 
provided by lemma|2] It is specihed by the initial value 1.5, by the set { 15, 16, 17.5, 21, 25, 27 } of abscissae 
7 i, i = 1,..., 6, at which the slope changes, and by the set { 1, 0, 0.5, 1, 2, 3 } of slopes pi, i = 1,..., 6, in the 
various intervals. 

Case ii) in which it is assumed ^2 = 1 (and (5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable r which corresponds to 
the processing time pf 2 . 3 , the following function 

a 2,3 max{f 4 + sfi ,2 + r - dd 2,3 , 0} + /32 “ t-) + SCi ,2 + </ 2 , 3 , 2 (^ 5 ) 


Davide GIgllo 


DIBRIS - University of Genova 


66 

















Fundamental lemmas for the determination of optimal control strategies 
for a class of single machine family scheduling problems 


that can be written as /(pi 2,3 + ^ 4 ) + g{pt 2 , 3 ) being 

f{pt2,3 + U) = max{pt2,3 + ^4 - 37 , 0} + 0.5 + J2,3,2ip^2,3 + t4 + 1) 


1.5 • (6-^^ 2 , 3 ) 


g(j>t2,3) = 


The function ^^2 3 (^ 4 ) = argminpt^: 

lemma[T] It is (see figure [T09l l 


pt2,3 € [4, 6) 
pt2,3 i [4,6) 

{f{pt 2,3 + ^ 4 ) + g{pt 2 , 3 )}, with 4 < pt 2^3 < 6, is determined by applying 


[6 t4< 17.5 

pt 2 3 ( 14 ) = Xeiti) with a;e(f 4 ) = < —<4 + 23.5 17.5 < <4 < 19.5 

I 4 <4 > 19.5 


Api°3(t4) 


\ 




Figure 109: Optimal processing time pf^ 3 (<4), under the assumption ^2 = 1 in state [2 2 1 <4]^. 

The conditioned cost-to-go J 22 i(^4 I ^2 = 1) = /(p <2 3 (^ 4 ) + ^ 4 ) + g{pt 2 3 (^ 4 ))’ illustrated in figure [TTOl is 
provided by lemma|2] It is specified by the initial value 1.5, by the set { 13.5, 17.5, 23.5, 33 } of abscissae 
* = 1,..., 4, at which the slope changes, and by the set { 1, 1.5, 2, 3 } of slopes i = 1,..., 4, in the various 
intervals. 



Figure 110 : Conditioned costs-to-go J 22 i (<4 I <^1 = 1) und +22 i (^4 I ^2 = 1) in state [2 2 1 < 4 ]^. 


In order to find the optimal cost-to-go J22 1 (^ 4 ), it is necessary to carry out the following minimization 

"^2,2. 1(^4) = niin { J2,2 .i(^4 I <^1 = 1 ) , -^2.2,1(^4 I ^2 = 1)} 

which provides, in accordance with lemma|4l the continuous, nondecreasing, piecewise linear function illustrated 
in figure nm 

The function J 22 i(< 4 ) is specified by the initial value 0.5, by the set { 15, 16, 17.5, 21, 25, 27 } of abscissae 7 ^, 
i = 1,..., 6 , at which the slope changes, and by the set { 1, 0, 0.5, 1, 2, 3 } of slopes pi, i = 1,. .., 6 , in the 
various intervals. 

Since 2 1 (<4 j ^1 = 1) is always the minimum (see again figure [TTOl i. the optimal control strategies for this state 
are 


<5?(2,2,1,<4) 


t°(2,2,1,<4) 


V <4 

<52° (2, 

2,1, < 4 ) 

= 0 

8 

<4 

< 15 


—<4 + 

23 15 

< <4 < 

16 

8 

16 

< <4 < 

21 

—<4 + 

29 21 

< <4 < 

25 

4 

<4 

> 25 
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Ar°(2,2, 1 , 44 ) 



ti 


Figure 112: Optimal control strategy t° (2, 2,1, t^) in state [2 2 1 ^4]^. 


The optimal control strategy r°(2, 2, 1 , ^ 4 ) is illustrated in figure fTT2l 
Stage 4 - State [3 12 * 4 ]^ (S'15) 

In state [3 12 ^ 4 ]^, the cost function to be minimized, with respect to the (continuos) decision variable r and to 
the (binary) decision variables Si and <52 is 

( 5 i [q!i, 4 max{<4 + 3^2,1 + t - ddi^4 , 0 } + / 3 i - t) + SC2.1 + >/Xi,i(^ 5 )] + 

+ 62 [a2,2 max{t4 + st2,2 + t - dd2,2 , 0} + /32 (pt™™ “ '^) + SC2.2 + -^3,2,2 (^5)] 

Case i) in which it is assumed 5i = 1 (and S 2 = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time the following function 

0:14 max{f4 + sf2,i + T — ddi^4 , 0} + /3i (pfi°“ - t) + sc2,i + J4^i^i{t5) 

that can be written as /(pfi ,4 + ^ 4 ) + 5 (pfi, 4 ) being 

f{pti,4 + t 4 ) = 0.5 • max{pfi4 + 14 - 40.5 , 0} + 1 + J4,i,i(pfi,4 + ^4 + 0.5) 


g{ptiA) 


8-pfi.4 pfi.4e[4,8) 
0 pfi,4^[4,8) 


The function 4(^4) = argmin^f^ 4{/(pfi,4 + ^4) + p(pfi,4)}, with 4 < pfi,4 < 8, is determined by applying 
lemma[T] It is (see figure fTTSl) 


[8 t 4 < 8.5 

ptl 4 ( 14 ) = Xe{t 4 ) with a;e(f4) = < —f 4 + 16.5 8.5 < ^4 < 12.5 

[4 t 4 > 12.5 

The conditioned cost-to-go ^ 2(^4 I ^1 = 1) = f{pti 4 (^ 4 ) + ^ 4 ) + 9 {pti 4 (^ 4 ))^ illustrated in figure [TTSl is 
provided by lemma|2] It is specified by the initial value 1.5, by the set { 8.5, 20.5, 22.5, 36.5 } of abscissae 7 ^, 
i = 1,..., 4, at which the slope changes, and by the set { 1, 1.5, 2, 2.5 } of slopes /r^, i = 1,..., 4, in the various 
intervals. 
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ti 


Figure 113: Optimal processing time pt^ 4 (^ 4 ), under the assumption = 1 in state [3 12 t 4 ]^. 


Case ii) in which it is assumed ^2 = 1 (and (5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable r which corresponds to 
the processing time pt 2 , 2 , the following function 


02,2 max{f 4 + st2,2 + T - dd2,2 , 0} + /32 “'’■)+ SC2,2 + >^3,2, 2 (^ 5 ) 

that can be written as f(pt 2.2 + ti) + g{pt 2 , 2 ) being 

f{pt2,2 + ti) = max{pf2,2 + f4 - 24,0} + J^^2,2ipt2,2 + t^) 


9{pt2,2) 


1.5 • (6-pf2,2) pf2,2e[4,6) 

0 pf2.2^[4,6) 


The function pt^ 2 (^ 4 ) = arg min^t^ ^ {f{pt 2,2 + ti) + g{pt 2 , 2 )}, with 4 < pf 2,2 < 6, is determined by applying 
lemma[T] It is (see figure fTT4li 


[6 U< 20.5 

pt2 2{ti) = Xeiti) with Xe(f4) = < —<4 + 26.5 20.5 < <4 < 22.5 

I 4 <4 > 22.5 




\ 


ti 


Figure 114: Optimal processing time p <2 2 (^ 4 )’ under the assumption ^2 = 1 in state [3 12 < 4 ]^. 

The conditioned cost-to-go JI 4 2(^4 I ^2 = 1) = /(p <2 2 (^ 4 ) + ti) + 5 (p <2 2 (^ 4 ))’ illustrated in figure [TTSl is 
provided by lemma|2] It is specified by the initial value 1, by the set { 18, 20.5, 28 } of abscissae 7 ^, < = 1,..., 3, 
at which the slope changes, and by the set { 1, 1.5, 2.5 } of slopes i = 1,..., 3, in the various intervals. 



Figure 115: Conditioned costs-to-go Jg 4 2(^4 I <^1 = 1) and Jg 4 2 (i ^4 I ^2 = 1) in state [3 12 < 4 ]^. 

In order to find the optimal cost-to-go Jg 4 2 (<4)^ it is necessary to carry out the following minimization 

•^3, 1 , 2 (^ 4 ) = niin { J3,4,2(<4 I 1^1 = 1) j >^3,1, 2(^4 I ^2 = 1)} 

which provides, in accordance with lemmalU the continuous, nondecreasing, piecewise linear function illustrated 
in figure [TT 6 l 
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0 

Figure 116; Optimal cost-to-go J| ^ 2 (^ 4 ) ^^ate [3 12 t 4 ]^. 


The function J 3 ^ 2 (^ 4 ) specified by the initial value 1, by the set { 18, 20.5, 28 } of abscissae i = 1,..., 3, 
at which the slope changes, and by the set { 1, 1.5, 2.5 } of slopes * = 1,. .., 3, in the various intervals. 

Since J 3 1 2(^4 I ^2 = 1) is always the minimum (see again figure fTTsT l. the optimal control strategies for this state 
are 

(5J(3, l,2,f4) =0 Vf4 < 53 ( 3 ,1, 2 ,^ 4 ) = 1 Vf4 

(6 U< 20.5 

t°( 3, l,2,f4) = < -<4 + 26.5 20.5 < <4 <22.5 
[4 <4 > 22.5 

The optimal control strategy t°(3, 1, 2 , < 4 ) is illustrated in figure [TT71 

AT°(3.1,2,t4) 

\_ 

ti 


Figure 117: Optimal control strategy t° (3,1, 2, < 4 ) in state [3 12 < 4 ]^. 

Stage 4 - State [3 11 < 4 ]^ (5'14) 

In state [3 11 < 4 ]^, the cost function to be minimized, with respect to the (continues) decision variable r and to 
the (binary) decision variables and 82 is 

(5i [q;i ,4 max {<4 + sti^i + t — ddi^i , 0} + /3i - t) + sci,i + + 44.1 (< 5 )] + 

+ ^2 [a 2,2 max {<4 + sti ^2 + r - dd 2,2 , 0} + /32 (p< 2 °“ -'’") + sci ,2 + -<^ 3 , 2 , 2 fe)] 


Case i) in which it is assumed di = 1 (and 62 = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time p<i_ 4 , the following function 

ai ^4 max {<4 + sfij + t - , 0} + - t) + sci,i + J4_i_i(<5) 

that can be written as /(p<i ,4 + <4) + 5 (p<i, 4 ) being 


f{pti ,4 + < 4 ) = 0.5 • max{pti _4 + <4 - 41,0} + JZi,i{pti,4 + < 4 ) 


g{pti,4) 


8-p<i,4 p<i,4e[4,8) 
0 p<i,4^[4,8) 
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The function 4(^4) = argminptj 4{/(pfi,4 + ^4) + 5(pfi,4)}, with 4 < pfi,4 < 8, is determined by applying 
lemma[T] It is (see figure fTTSl l 

f 8 ^4 < 9 

ptl 4(^4) = a:e(<4) with Xeit ^) = < —<4 + 17 9 < ^4 < 13 

I 4 f4 > 13 





ti 


Figure 118; Optimal processing time pf 4 4 (^ 4 )’ under the assumption = 1 in state [3 11 f4]^. 


The conditioned cost-to-go J 3 4 4(^4 | (54 = 1 ) = f{pt° 4 (^ 4 ) + ^ 4 ) + g{pt\ 4 (^ 4 )), illustrated in figure [T20l 
is provided by lemma |2] It is specified by the initial value 0.5, by the set { 9, 21, 23, 37 } of abscissae 7 ^, 
* = 1,..., 4, at which the slope changes, and by the set { 1, 1.5, 2, 2.5 } of slopes pi, * = 1,..., 4, in the various 
intervals. 

Case ii) in which it is assumed ^2 = 1 (and (5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable r which corresponds to 
the processing time pf 2 , 2 , the following function 


(22,2 max{f 4 + sti^2 + T - dd2,2 , 0} + /32 (pf2°™ “'’■)+ SCl ,2 + ^ 3 , 2 , 2 (^ 5 ) 
that can be written as /(pf 2,2 + ^ 4 ) + g{pt 2 , 2 ) being 


f{pt 2,2 + U) = max{p< 2,2 + f 4 - 23 , 0} + 0.5 + J 3 , 2 , 2 (F^ 2.2 +^4 + 1) 


g{ph,2) 


1.5 • (6-pf2,2) pf2,2e[4,6) 
0 pt2,2 ^ [4,6) 


The function pf 2 . 2 (^ 4 ) = u^'guiinptj 2 {/(pf 2,2 + ^ 4 ) + g{pt 2 ,z)}, with 4 < pf 2,2 < 6, is determined by applying 
lemma[T] It is (see figure [TTOl l 


[6 ti< 19.5 

P ^2 2 (^ 4 ) = 2 :e(f 4 ) with a;e(f 4 ) = < —<4 + 25.5 19.5 < <4 < 21.5 

1 4 <4 > 21.5 




\ 


ti 


Figure 119: Optimal processing time p <2 2 (^ 4 )^ under the assumption ^2 = 1 in state [3 11 < 4 ]^. 

The conditioned cost-to-go JI 4 4(<4 j ^2 = 1) = /(p <2 2 (^ 4 ) + ^ 4 ) + 5(f^2 2 (^ 4 ))’ illustrated in figure [T 20 l is 
provided by lemma|2] It is specified by the initial value 1, by the set { 17, 19.5, 27 } of abscissae 7 ^, < = 1,..., 3, 
at which the slope changes, and by the set { 1, 1.5, 2.5 } of slopes /i^, < = 1,..., 3, in the various intervals. 

In order to find the optimal cost-to-go J| 4 4 (< 4 ), it is necessary to carry out the following minimization 

'^3,i,i(^ 4) = uiinj J3 4 4(<4 I (5i = 1), I ^2 = 1)} 

which provides, in accordance with lemmalU the continuous, nondecreasing, piecewise linear function illustrated 
in figure ll 2 l 1 
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Figure 120; Conditioned costs-to-go J 3 ]^(i 4 | (5i = 1) and J 3 ^ ]^(f :4 | (52 = 1) in state [3 1 1 i 4 ]^. 



The function J 3 3 3 (^ 4 ) is specified by the initial value 0.5, by the set { 9, 10, 17, 19.5, 27 } of abscissae 7 ^, 
i = 1,..., 5, at which the slope changes, and by the set { 1, 0, 1, 1.5, 2.5 } of slopes i = 1,..., 5, in the 
various intervals. 


Since J 3 1 1(^4 | <5i = 1) is the minimum in (— cxd , 10), and J 3 3 3(^4 | (52 = 1) is the minimum in [10, + 00 ), the 
optimal control strategies for this state are 


5?(3,l,l,i4) 


1 t4 < 10 
0 f4 > 10 


(52°(3,l,l,f4) = 


T°(3,l,l,f4) = 


8 

—ti + 17 
6 

-U + 25.5 
4 


f4 < 9 

9 < f4 < 24.5 

10 < f4 < 19.5 
19.5 < f4 < 21.5 
is > 21.5 


0 f4 < 10 
1 i4 > 10 


The optimal control strategy r°(3,1, 1 , ^ 4 ) is illustrated in figure fT22l 

At°(3, 1 , 174 ) 

-S 

-\ 


ti 


Figure 122: Optimal control strategy t°(3, 1,1, ^ 4 ) in state [3 11 14 ]^. 


Stage 4 - State [4 0 1 * 4 ]^ (S'13) 

In state [4 0 1 ^ 4 ]^ all jobs of class Pi have been completed; then the decision about the class of the next job to 
be executed is mandatory. The cost function to be minimized in this state, with respect to the (continues) decision 
variable r only (which corresponds to the processing time pf 2 ,i), is 

0 ( 2,1 max{f 4 + sti ^2 + r - dd 2 ^i , 0 } + /32 + ^^ 1,2 + •l 4 .i, 2 (f 5 ) 
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that can be written as f{pt 2 .i + ^ 4 ) + g{pt 2 ,i) being 


f{pt2,i +t4) = 2 ■ max{pi 2 ,i + ^4 - 20 , 0} + 0.5 + ^ 44 _ 2 (P^ 2 ,i + t4 + 1) 


9{pt2,i) 


1.5 • ( 6 -pi 2 .i) pt2.iG[4,6) 

0 pt2,i^[4,6) 


The function pi 2 . 1 (^ 4 ) = 9 'rgminpt 2 ,i{/(p^ 2 ,i + ^ 4 ) + g{pt 2 ,i)}, with 4 < pt 2 p < 6 , is determined by applying 
lemma[T] It is 


pt°2i{t4) = Xe{t4) with a:e(f 4 ) 


6 t 4 < 14 

-t4 + 20 14 < f 4 < 16 
4 t 4 > 16 


Taking into account the mandatory decision about the class of the next job to be executed, the optimal control 
strategies for this state are 

5°(4,0,l,f4) = 0 Vf4 <52(4,0,l,f4) = 1 Vf4 
r 6 t4 < 14 

T°(4,0,l,f4) = < -f4 + 20 14<f4<16 

[4 t 4 > 16 

The optimal control strategy r°(4,0,1, ^ 4 ) is illustrated in figure fT2^ 

at°(4,0, 1 , 4 ) 


\ 


^5 


Figure 123: Optimal control strategy r°(4, 0,1, ^ 4 ) in state [4 0 1 ^ 4 ]^. 


The optimal cost-to-go J 4 Q 1 (^ 4 ) = /{pt^ 1 (^ 4 ) + ^ 4 ) + g{pt 2 1 (^ 4 ))^ illustrated in figure [T24l is provided by 
lemma|2] It is specified by the initial value 0.5, by the set {11, 14, 16, 21, 23 } of abscissae 7 ^, * = 1,..., 5, 
at which the slope changes, and by the set { 1, 1.5, 3, 3.5, 4 } of slopes pi, i = 1,..., 5, in the various inter¬ 
vals. 



Stage 3 - State [0 3 2 * 3 ]^ (512) 

In state [0 3 2 t^]’^ all jobs of class P 2 have been completed; then the decision about the class of the next job to 
be executed is mandatory. The cost function to be minimized in this state, with respect to the (continues) decision 
variable r only (which corresponds to the processing time pti,i), is 

0:14 maxjfs + st 2 p + T — ddi^i , 0} + / 3 i (pi"®™ - t) + sc2,i + 
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that can be written as /(pii.i + is) + g{pti^i) being 


+ ts) = 0.75 • max{pti^i + ^3 — 18.5,0} + 1 + Ji^ 3 j{pti,i + ^3 + 0.5) 


g{pti,i) 


8-pti^i pti^ie[A,8) 
0 pti,i^[4,8) 


The functional? ^( 13 ) = argminptj 
lemma[T] It is 


^ 3 ) + 5(P^i.i)}’ with 4 < < 8, is determined by applying 


[8 l 3 < 4.5 

pthih) = Xeits) with a;e(l 3 ) = < -13 + 12.5 4.5 < 13 < 8.5 

I 4 I 3 > 8.5 


Taking into account the mandatory decision about the class of the next job to be executed, the optimal control 
strategies for this state are 

5 ?( 0 , 3 , 2 ,l 3 ) = l VI 3 52 °( 0 , 3 , 2 ,l 3 ) = 0 VI 3 

r 8 I 3 < 4.5 

T°( 0 , 3 , 2 ,l 3 ) = <^ -I 3 + I 2.5 4.5 <13 <8.5 
[4 I 3 > 8.5 

The optimal control strategy r°(0, 3, 2 , 13 ) is illustrated in figure [T25l 


AT°(0,3,2,t3) 



h 


Figure 125; Optimal control strategy t°(0, 3, 2, 13) in state [0 3 2 13 ]^. 

The optimal cost-to-go Jg 3 2 (^ 3 ) = fiptl 1 (^ 3 ) + ^ 3 ) + g{pti 1 (^ 3 )), illustrated in figure [126] is provided by 
lemma|2] It is specified by the initial value 1, by the set { 4.5, 14.5, 15.5, 16.5, 20.5 } of abscissae 7 ^, 1 = 1,..., 5, 
at which the slope changes, and by the set { 1, 1.75, 2.25, 2.75, 3.25 } of slopes (Xi, i = 1 , ..., 5, in the various 
intervals. 



Figure 126: Optimal cost-to-go +33 2 (^ 3 ) in state [0 3 2 

Stage 3 - State [12 2 * 3 ]^ (S'!!) 

In state [12 2 ta]^, the cost function to be minimized, with respect to the (continuos) decision variable r and to 
the (binary) decision variables and 82 is 

5i [ai,2 maxjfa -(- sf2,i + t - ddi^2 , 0} -F /3i -''") + sc 2 ,i + + 2 , 2.1 (^ 4 )] + 

+ S2 [a 2,3 maxjfa -F sf 2,2 + t - +^2,3 , 0 } + ^2 (pf™™ “ "r) + ■SC2.2 + +i° 3 , 2 (^ 4 )] 
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Case i) in which it is assumed = 1 (and 62 = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time the following function 

ai^2 maxjfs + sf2,i + r - ddi^2 , 0} + /3i - t) + sc2,i + ./2, 2 , 1 (^ 4 ) 

that can be written as /(pfi ,2 + ^ 3 ) + g{pti, 2 ) being 


f{pti ,2 + ts) = 0.5 • max{pfi ,2 + — 23.5 , 0} + 1 + ^ 2 , 2 .i(P^i ,2 + ^3 + 0.5) 


g{pti, 2 ) = 


8-pfi.2 pfi.2e[4,8) 

0 pfi,2^[4,8) 


The function 2 (^ 3 ) = argmin^t^ 2 {/(pfi ^2 + ^ 3 ) + g{pti. 2 )}, with 4 < pti ^2 < 8 , is determined by applying 
lemma[T] It is (see hgure fTZTI) 


Pii,2{h) 


Xs{h) h < 7.5 
Xe{h) h > 7.5 


with Xs{h) 


8 h< 6.5 

-fa + 14.5 6.5 < fa < 7.5 ’ 


and Xe{tz) 


8 7.5 < fa < 12.5 

-fa+ 20.5 12.5 < fa <16.5 
4 fa > 16.5 


AP*l,2(t3) 



*3 


Figure 127: Optimal processing time pt^ 2 (^ 3 )^ under the assumption = 1 in state [12 2 fa]^. 


The conditioned cost-to-go Ji^ 2 , 2(^3 I ^1 = 1) = /(p^i, 2 (^ 3 ) + ^ 3 ) + 5 (f'^i, 2 (^ 3 ))’ illustrated in hgure [T29l is 
provided by lemma|2] It is specified by the initial value 1.5, by the set { 6.5, 7.5, 9, 12.5, 19.5, 20.5, 22.5 } of 
abscissae 7^,1 = 1,..., 7, at which the slope changes, and by the set { 1, 0, 0.5, 1, 1.5, 2.5, 3.5 } of slopes pi, 
i = 1,... ,7, in the various intervals. 

Case ii) in which it is assumed ^2 = 1 (and (5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time pf 2 , 3 , the following function 


a2,3 max{fa + sf 2,2 + r - dd2,3 , 0} + /32 (pf^™ - t) + SC 2,2 + -ir,3,2(^4) 
that can be written as /(pf 2,3 + fa) + g{pt 2 , 3 ) being 

f{pt2,3 + fa) = max{pf2,3 + fa - 38, 0} + Jr,a,2(pf2,3 + h) 


g{pt2,3) 


1.5 • ( 6 -pf2,3) pf2,3e[4,6) 

0 pf2,a^[4,6) 


The function pf 2 3 (fa) = argminpt 2 , 3 {/(pf 2,3 + fa) + 5 (pf 2 , 3 )}, with 4 < pf 2,3 < 6 , is determined by applying 
lemma[T] It is (see figure [T28l l 


[6 fa < 13.5 

pfg 3 (f 3 ) = Xe{t 3 ) with Xeit 3 ) = < —fa + 19.5 13.5 < fa < 15.5 

I 4 fa > 15.5 


The conditioned cost-to-go J° 2 , 2 (f 3 | ^2 = 1) = /(pf 2 , 3 (f 3 ) + fa) + ^(pfg.aCfa))’ illustrated in figure [T29l is 
provided by lemma|3 It is specified by the initial value 1, by the set { 6.5, 13.5, 16.5, 20.5, 34 } of abscissae 7 ^, 
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APt2,3(<3) 


\ 


*3 


Figure 128 : Optimal processing time 3(^3), under the assumption ^2 = 1 in state [12 2 ^3]^. 



Figure 129 : Conditionedcosts-to-go J^2 2(^3 I <^1 = 1 ) ^nd J°2 2(^3 I ^2 = 1 ) in state [12 2 . 


i = 1,... , 5, at which the slope changes, and by the set { 1, 1.5, 2, 2.5, 3.5 } of slopes pi, i = 1,. .., 5, in the 
various intervals. 

In order to find the optimal cost-to-go 2 2 (^ 3 )’ i'^ i^ necessary to carry out the following minimization 

'^ 1 , 2 , 2 (^ 3 ) = niin {t/i_2,2(^3 I <^i = 1) j '^ 1 , 2 , 2(^3 I ^2 = 1)} 

which provides, in accordance with lemmalU the continuous, nondecreasing, piecewise linear function illustrated 
in figure fTSOl 



0 

Figure 130 : Optimal cost-to-go J°2 2(^3) in state [12 2 ^3]^. 


The function J °2 2 (^ 3 ) specified by the initial value 1, by the set { 6.5, 8, 9, 12.5, 19.5, 20.5, 22.5, 30.25, 34 } 
of abscissae 7^,1 = 1,..., 9, at which the slope changes, and by the set { 1, 0, 0.5, 1, 1.5, 2.5, 3.5, 2.5, 3.5 } of 
slopes Pi, i = 1,... ,9, in the various intervals. 

Since J° 2 2(^3 I ^1 = 1) is the minimum in [8, 30.25), and ,JY 2(^3 I <^2 = 1) is the minimum in (—00, 8) and in 
[30.25, +cxd), the optimal control strategies for this state are 


(5?(l,2,2,f3) = 

r“(l,2,2,13) = 


0 l3 < 8 

1 8<l3< 30.25 < 52 ( 1 . 2 , 2 , 13 ) 

0 I 3 > 30.25 

6 I 3 < 8 

8 8 < I 34 < 12.5 

-I 3 -F 2 O .5 12.5 <13 <16.5 

4 I 3 > 16.5 


1 I 3 < 8 

0 8 < I 3 < 30.25 
1 I 3 > 30.25 
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The optimal control strategy r°(l, 2 , 2 , t^) is illustrated in figure fOTI 

A r°(l,2,2,t3) 



*3 

- 0 -^ 

Figure 131: Optimal control strategy t°(1, 2, 2, t^) in state [12 2 ^ 3 ]^. 

Stage 3 - State [12 1 *3]^ (S'lO) 

In state [12 1 the cost function to be minimized, with respect to the (continuos) decision variable r and to 
the (binary) decision variables Si and <52 is 

(5i [ai ,2 max{t 3 + + r - ddi ^2 , 0} + /3i - r) + sci,i + ^ 2 , 2.1 (^ 4 )] + 

+ S 2 [a 2,3 max{t 3 + sfi ,2 + r - dd2,3 , 0} + /32 (ptr™ “'t) + sci ,2 + -^r,3.2(^4)] 


Case i) in which it is assumed (5i = 1 (and 82 = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time pfi, 2 , the following function 


q;i^ 2 maxjfa + sfij + t - ddi^2 , 0} + - t) + sci,i + J2,2,i(^4) 

that can be written as f{pti ,2 + fa) + 5 (pfi, 2 ) being 


f{pti ,2 + fa) = 0.5 • max{pfi ,2 + fa - 24,0} + Jl 2 ,i{pti ,2 + fa) 


g{pti, 2 ) 


8-pfi.2 pfi.2e[4,8) 

0 pfi,2^[4,8) 


The function pf° 2 (fa) = arg min^t^ J/(pfi ^2 
lemma[T] It is (see figure [T32l) 


ts) + 5 (pfi, 2 )}, with 4 < pfi ,2 < 8 , is determined by applying 


PiiAh) 


Xsih) fa < 8 
Xeih) fa > 8 


with Xsih) 


and Xeih) 


8 8 ^ fa < 13 

-fa+ 21 13 < fa <17 

4 fa > 17 


8 fa < 7 

—fa + 15 7 < fa < 8 





h 


Figure 132: Optimal processing time pf^” 2 (f 3 ), under the assumption = 1 in state [12 1 fa]^. 

The conditioned cost-to-go Ji, 2 ,i (^3 I ^1 = 1) = fipti, 2 (^ 3 ) + fa) + 9 ipti. 2 i^ 3 ))’ illustrated in figure [T34l is 
provided by lemma|2] It is specified by the initial value 0.5, by the set { 7, 8, 9.5, 13, 20, 21, 23 } of abscissae 7 ^, 
* = 1,..., 7, at which the slope changes, and by the set { 1, 0, 0.5, 1, 1.5, 2.5, 3.5 } of slopes pLi,i= 1,..., 7, in 
the various intervals. 

Case ii) in which it is assumed ^2 = 1 (and (5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time pf 2 , 3 , the following function 

a2,3 maxjfa + sti^2 + r - dd 2,3 , 0} + /32 (pf^™ - t) + SC72 + •773,2(^4) 
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that can be written as f{pt 2,3 + h) + 3 ( 73 ^ 2 , 3 ) being 

f{pt2,3 + ts) = ma.x{pt2,3 + is - 37 , 0} + 0.5 + Ji°3,2(pi2,3 + is + 1) 


9{pt2,3) 


1.5 • (6 -pi2,3) 

0 


The function pi 2 3 (is) = argminpt^.s 
lemma[T] It is (see figure [T33l l 


pt2,3 € [4, 6) 
pt2,3 i [4,6) 

{f{pt2,3 + is) + g{pt2,3)}, with 4 


< pt 2,3 < 6, is determined by applying 


[6 i3 < 12.5 

P ^2 3 (^ 3 ) = Xe{t 3 ) with Xe{t 3 ) = < —t 3 + 18.5 12.5 < is < 14.5 

I 4 i3 > 14.5 


t^P^2,3{h) 


\ 


h 


Figure 133: Optimal processing time pi^ 3 (i 3 ), under the assumption ^2 = 1 in state [12 1 is]^. 

The conditioned cost-to-go Ji^ 2 ,i (^3 I ^2 = 1) = f{pi 2 , 3 {^ 3 ) + ^s) + 5 (f^ 2 . 3 (^ 3 ))’ illustrated in figure [T34l is 
provided by lemma|2] It is specified by the initial value 1.5, by the set { 5.5, 12.5, 15.5, 19.5, 33 } of abscissae 
7 i, i = 1,..., 5, at which the slope changes, and by the set { 1, 1.5, 2, 2.5, 3.5 } of slopes /i^, i = 1,..., 5, in the 
various intervals. 



Figure 134: Conditionedcosts-to-go J [’2 i(i 3 | (5i = 1) and J °2 i(i 3 | ^2 = 1) in state [12 1 . 


In order to find the optimal cost-to-go J 32 1 (^ 3 ), it is necessary to carry out the following minimization 

•/r. 2 a(i 3 ) = min {jr,24(^3 I < 5 i = 1 ), Ji%,i(f 3 I <^2 = 1 )} 

which provides, in accordance with lemma|4l the continuous, nondecreasing, piecewise linear function illustrated 
in figure [T 35 ] 

The function JI 2 1 (^ 3 ) is specified by the initial value 0.5, by the set { 7, 8, 9.5, 13, 20, 21, 23 } of abscissae 7 ^, 
i = 1,..., 7, at which the slope changes, and by the set { 1, 0, 0.5, 1, 1.5, 2.5, 3.5 } of slopes pi,i = 1,..., 7, in 
the various intervals. 

Since 2 ^ (fa | = 1) is always the minimum (see again figure [T34l) . the optimal control strategies for this state 

are 

5 ?(l, 2 ,l,f 3 ) = l Vis < 52 °(l, 2 ,l,f 3 ) = 0 Vf 3 


' 8 

fs < 7 

-fs + 15 

7 < fs < 8 

8 

8 < fa < 13 

—fa -f 21 

13 < fa < 17 

4 

\ 

fs > 17 
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Ar°{l,2,l,t3) 



h 


Figure 136: Optimal control strategy t°(1, 2,1, ^ 3) in state [12 1 


The optimal control strategy r°(l, 2,1, t^) is illustrated in figure[T36] 

Stage 3 - State [2 1 2 * 3 ]^ (S'9) 

In state [2 12 the cost function to be minimized, with respect to the (continues) decision variable r and to 
the (binary) decision variables Si and S 2 is 

(5i [q!i ,3 maxjta + 5 ^ 2,1 + t- ddi^s, 0} + /3i - r) + SC 2.1 + J^i^iltd)] + 

+ S 2 [a2,2 maxjta + st2,2 + t - dd2,2 , 0} + /32 (pt™™ + SC 2.2 + •/2,2,2(^4)] 

Case i) in which it is assumed Si = 1 (and S 2 = 0). 

In this case, it is necessary to minimize, with respect to the (continues) decision variable t which corresponds to 
the processing time pfi^a, the following function 

0:1,3 maxjfa + sf2,i + t — ddi^s , 0} + / 3 i (pfi°“ - t) + sc2,i + ./a,!,1(^4) 

that can be written as fipti^s + fa) + ^(pfi.a) being 

f{pti ,3 + fa) = 1-5 ■ max{pfi,3 + fa - 28.5 , 0} + 1 + J3,i,i(pfi,3 + fa + 0.5) 


g{pti,3) 


8-pfi.3 pfi.3G[4,8) 

0 pfi,3^[4,8) 


The function pf° 3(fa) = argmin^t^ 3{/(pfi,3 + fa) + p(pfi,3)}, with 4 < pfi,3 < 8, is determined by applying 
lemma[T] It is (see figure [TJTI i 




a:s(f3) h < 1-5 

Xeih) h > 1-5 


with Xs{h) 


8 fa < 0.5 

-fa+ 8.5 0.5 < fa <1.5 ’ 


and Xe{h) 


8 1.5 < fa < 8.5 

-fa+ 16.5 8.5 < fa < 12.5 
4 fa > 12.5 


The conditioned cost-to-go J 21 2 ,{t 3 | ^1 = 1) = /(pfi 3(f3) + fs) + 9{pti 3(^3))^ illustrated in figure [T39l is 
provided by lemma|2l It is specified by the initial value 1.5, by the set { 0.5, 1.5, 8.5, 15, 22.5, 24.5 } of abscissae 
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AP<1.3(<3) 



*3 


Figure 137: Optimal processing time 3 (^ 3 )^ under the assumption = 1 in state [2 12 ^ 3 ]^. 


7 i, i = 1,..., 6 , at which the slope changes, and by the set { 1,0, 1, 1.5, 2.5, 4 } of slopes i = 1,..., 6 , in the 
various intervals. 


Case ii) in which it is assumed ^2 = 1 (and (5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable r which corresponds to 
the processing time pf 2 , 2 , the following function 


a2,2 max{f3 + 5 ^ 2.2 + r - dd2,2 , 0} + /32 “ t") + SC2,2 + </2,2,2(^4) 

that can be written as /(pf 2,2 + ^ 3 ) + g{pt 2 , 2 ) being 

f{pt2,2 + ts) = ma.x{pt2,2 + f 3 - 24 , 0 } + J2,2.2(p^2,2 + ^3) 


9{pt2,2) 


1.5 • ( 6 -pf 2 . 2 ) pf2,2e[4, 6 ) 
0 pt 2,2 ^ [4, 6 ) 


The function pf 2 . 2 (^ 3 ) = argmin^tj 2 {/(pf 2,2 + ^ 3 ) + g{pt 2 , 2 )}, with 4 < pf 2.2 < 6 , is determined by applying 
lemma[T] It is (see figure [TJSl l 


Pt 2 , 2 ^h) = Xeits) with Xe{h) 


6 fs < 18 

-h + 24 18 < fs < 20 
4 fg > 20 




\ 


h 


Figure 138: Optimal processing time pf^ 2 (^ 3 )^ under the assumption ^2 = 1 in state [2 12 

The conditioned cost-to-go J 21 2(^3 j ^2 = 1) = f{pt 2 2 (^ 3 ) + ^ 3 ) + 5(P^2 2 (^ 3 ))’ illustrated in figure [T39l is 
provided by lemma|2| It is specified by the initial value 1, by the set { 8.5, 10, 11, 14.5, 18, 20, 20.5, 22.5, 28.25, 
30 } of abscissae ji, i = 1,..., 10, at which the slope changes, and by the set { 1, 0, 0.5, 1, 1.5, 2, 3, 4, 3, 4 } of 
slopes Pi, i = 1 ,..., 10, in the various intervals. 



Figure 139: Conditioned costs-to-go J2 i 2(^3 I = 1) and +2 1 2(^3 I ^2 = 1) in state [2 12 fg]^. 
In order to find the optimal cost-to-go J 2 i 2 (^ 3 )’ if i^ necessary to carry out the following minimization 

= min {+2° 12(^3 I = 1), +2 ,i.2(^3 I ^2 = 1 )} 
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which provides, in accordance with lemmalU the continuous, nondecreasing, piecewise linear function illustrated 
in figure 1 1401 



0 

Figure 140: Optimal cost-to-go J 2 i 2 (^ 3 ) in state [2 12 


The function ^ 2 (^ 3 ) i^ specified by the initial value 1, by the set { 8.5, 10, 11, 14.5, 18, 20, 20.5, 22.5, 24,16, 
24.5, 28.75, 30 } of abscissae ^i,i = 1,..., 12, at which the slope changes, and by the set { 1, 0, 0.5, 1, 1.5, 2, 3, 
4, 2.5, 4, 3, 4 } of slopes fj,i, i = 1,..., 10, in the various intervals. 


Since J2 12(^3 I = 1 ) is the minimum in [ 24 . 16 , 28 . 75 ), and J2 ^ 2(^3 I = 1 ) is the minimum in (—00, 24 . 16 ) 
and in [ 28 . 75 , +00), the optimal control strategies for this state are 


< 5 ?( 2 ,l, 2 ,f 3 ) = 


0 t3 <_24.16 
1 24.16 < tg < 28.75 
0 t3 > 28.75 


S°{2,l,2,t3) 


1 fg <_24.16 
0 24.16 <t3< 28.75 
1 fg > 28.75 


T°(2,l,2,f3) 


6 tg < 18 

—fg + 24 18 ^ fg < 20 
4 tg > 20 


The optimal control strategy r°(2,1, 2, tg) is illustrated in figure fT4T] 


Ar°(2, l,2,t3) 


\ 


h 


Figure 141: Optimal control strategy t°(2, 1, 2, tg) in state [2 12 tg]^. 


Stage 3 - State [2 1 1 fg]^ (S'8) 

In state [2 11 tg]^, the cost function to be minimized, with respect to the (continuos) decision variable r and to 
the (binary) decision variables and 82 is 

(5i[q!i, 3 maxjtg + stij + t - ddi^s , 0} +/ 3 i (ptg°“ - r) + sci,i + ^3,1,1 (t4)] + 

+ ^2 [< 22,2 maxjtg + sti ,2 + T - dd 2,2 , 0} + /32 (pt 2 °“ - t) + SCi ,2 + J 2 , 2 . 2 M] 


Case i) in which it is assumed = 1 (and 62 = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time pfi^g, the following function 

0:1,3 maxjfg + + T - ddi^3 , 0} + / 3 i (pi?®™ - t) + sci,i + J3,i,i(t4) 

that can be written as /(pfi ,3 + tg) + ^(pti^g) being 

f{pti,3 + tg) = 1.5 • max{pti ,3 + tg - 29,0} + Jli^i{ptl,3 + tg) 
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g{pti,3) 


8-pii.3 pii.3G[4,8) 

0 pii.3^[4,8) 


The function 3(is) = aigmiupt^^if {pti^s + ^3) + 9 {pti, 3 )}, with 4 < pti^^ < 8, is determined by applying 
lemma[T] It is (see figure fl42l l 


Ptlsih) 


Xsits) ts < 2 

Xelts) h>2 


with Xsih) 


8 ^3 < 1 

-f 3 + 9 1 < t 3 < 2 ’ 


and Xe{tz) 


8 1.5 < t3 < 9 

-f3 + 17 9 < t3 < 13 
4 f3 > 13 


AP<1,3(+) 



h 


Figure 142: Optimal processing time pfj 3(^3), under the assumption = 1 in state [2 11 


The conditioned cost-to-go J 2 .i,i (^3 I ^1 = 1) = fipti^sih) + t^) + gipti^^its)), illustrated in figure fT^ is 
provided by lemma|2] It is specified by the initial value 0.5, by the set { 1, 2, 9, 15.5, 23, 25 } of abscissae 7 ^, 
i = 1,..., 6, at which the slope changes, and by the set { 1, 0, 1, 1.5, 2.5, 4 } of slopes pi, i = 1,..., 6, in the 
various intervals. 

Case ii) in which it is assumed ^2 = 1 (and (5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time pf 2 . 2 , the following function 

a2,2 max{f3 + sti^2 + t - dd2,2 , 0} + /32 “'’") + sci,2 + ^ 2 , 2 , 2 (^ 4 ) 

that can be written as /(pf 2,2 + H) + g{pt 2 , 2 ) being 


f{pt2,2 + ts) = max{p<2,2 + f3 - 23 , 0} + 0.5 + J2,2,2(P^2,2 +^3 + 1) 


g{pt 2 , 2 ) 


1.5 • (6 -pf2,2) pf2.2€[4, 6 ) 

0 pf2,2^[4,6) 


The function pf2,2(^3) = argmin^t^ 2{/(pf2,2 + ^3) + g{pt 2 , 2 )}, with 4 < pf2,2 < 6, is determined by applying 
lemma[T] It is (see figure [l43t 


[6 f 3 < 17 

P^ 2 , 2 {h) = Xe{h) with Xeih) = ■^ -h + 23 17 < <3 < 19 

I 4 fg > 19 




\ 


ts 


Figure 143: Optimal processing time pf^ 2 (^ 3 )’ under the assumption ^2 = 1 in state [2 11 

The conditioned cost-to-go ^ 2 . 1,1 (^3 I ^2 = 1 ) = /(pf 2 , 2 (^ 3 ) + ^ 3 ) + 5 (pi 2 , 2 (^ 3 ))’ illustrated in figure [1441 is 
provided by lemma|2] It is specified by the initial value 1.5, by the set { 7.5, 9, 10, 13.5, 17, 19, 19.5, 21.5, 27.25, 
29 } of abscissae 7^,1 = 1,. •., 10, at which the slope changes, and by the set { 1, 0, 0.5, 1, 1.5, 2, 3, 4, 3, 4 } of 
slopes Pi, i = 1 ,..., 10, in the various intervals. 
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Figure 144; Conditioned costs-to-go J 21 1(^3 | (5i = 1) and J 21 1(^3 | (52 = 1) in state [2 11 . 


In order to find the optimal cost-to-go J 21 1 (^ 3 ), it is necessary to carry out the following minimization 

"^ 2 , 1 , 1 (^ 3 ) = min {J2,i,i(f3 I <5i = 1 ), -^2a.i(^3 I ^2 = 1 )} 

which provides, in accordance with lemma|4l the continuous, nondecreasing, piecewise linear function illustrated 
in figure [145] 



The function J 2 i 1 (^ 3 ) is specified by the initial value 0.5, by the set { 1, 2, 9, 11, 13.5, 17, 19, 19.5, 20.6, 23, 25 
} of abscissae 7^,1 = 1,..., 11, at which the slope changes, and by the set { 1,0, 1, 0.5, 1, 1.5, 2, 3, 1.5, 2.5, 4 } 
of slopes yti, f = 1 ,..., 11 , in the various intervals. 

Since J 2 11(^3 | i5i = 1) is the minimum in (—00, 2), in [ 9 , 11], and in [20.6, +00), and J 2 11(^3 | <52 = 1) is the 
minimum in [ 2 ,9] and in [ 11 , 20 . 6 ], the optimal control strategies for this state are 


51(2,IXh) 


' 1 h<2 

0 2 < t 3 < 9 
< 1 9 < fa < 11 
0 11 < f3 < 20.6 

1 fa > 20.6 


<52“(2,l,l,f3) 


'0 fa < 2 

1 2 < fa < 9 

< 0 9 < fa < 11 
1 11 < fa < 20.6 

0 fa > 20.6 


' 8 

fa < 1 

—fa + 9 

1 < fa < 2 

6 

2 < fa < 9 

-fa + 17 

9 < fa < 11 

6 

11 < fa < 17 

—fa + 23 

17 < fa < 19 

4 

\ 

fa > 19 


The optimal control strategy r°(2,1,1, fa) is illustrated in figure [l46l 
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A r°( 2 ,1,1,43) 


N 


\ 


- 0 -^ 

Figure 146: Optimal control strategy r°(2,1,1, ^ 3 ) in state [2 11 ^ 3 ]^. 

Stage 3 - State [3 0 1 * 3 ]^ (S'?) 

In state [3 0 1 ^ 3 ]^, the cost function to be minimized, with respect to the (continues) decision variable r and to 
the (binary) decision variables Si and <52 is 

(5i [q;i ,4 max{t 3 + + r - ddi ^4 , 0 } + /3i - r) + sci,i + J 4 _o.i(^ 4 )] + 

+ ^2 [a2,i maxjts + sti^2 + t - dd2,i , 0} + /32 + sci,2 + -/a,!, 2 (^ 4 )] 


Case i) in which it is assumed = 1 (and 62 = 0). 

In this case, it is necessary to minimize, with respect to the (continues) decision variable t which corresponds to 
the processing time the following function 


0:14 max{f3 + + T - ddi ^4 , 0} + ,81 - t) + sci,i + 

that can be written as /(pfi,4 + ^3) + p(pfi,4) being 

f{pti,4 + ts) = 0.5 • max{pfi4 + f3 - 41, 0} + Jlo^i{pti,4 + ta) 

f 1 \ / 8 -pfi,4 pfi,4 e [4,8) 

»(!"w> = l0 p(,,4^|4,8) 

The function pf° 4(f3) = argmin^t^ ^{/(pfi_4 + f3) + gipti^)}, with 4 < pti ^4 < 8, is determined by applying 
lemma[T] It is (see figure [l47l) 

f 8 ^3 < 3 

ptl 4 {tz) = Xe{h) with a;e(f3) = ■{ -fa + 23 3 < ta < 7 

4 fa > 7 


4Pil.4(*3) 


h 

-> 


Figure 147: Optimal processing time pt^ 4 (^ 3 ), under the assumption = 1 in state [3 0 1 fa]^ 


The conditioned cost-to-go J^^^iits j = 1) = fiptl ^its) + t^) + gipti ^its)), illustrated in hgure [T49l is 
provided by lemma|2] It is specihed by the initial value 0.5, by the set { 3, 10, 12, 17, 19, 37 } of abscissae 7 ^, 
* = 1,..., 6, at which the slope changes, and by the set { 1, 1.5, 3, 3.5, 4, 4.5 } of slopes pLi, i = 1,..., 6, in the 
various intervals. 

Case ii) in which it is assumed ^2 = 1 (and (5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable r which corresponds to 
the processing time pf 2 ,i, the following function 

02,1 maxjfa + sfi,2 + r - dd2,i , 0} + /32 (pf™™ “ '^) + sci.2 + -^ 3 , 1 , 2 (^ 4 ) 

that can be written as /(pf 2 .i + fa) + 5 (pf 2 ,i) being 

/(pf 2 ,i + fa) = 2 ■ max{pf 2 ,i + fa - 20 , 0} + 0.5 + 8 ^^,i, 2 (pf 2 .i + fa + 1) 
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gipt2,i) = 


1.5 • ( 6 -pi 2 ,i) pi2.iG[4,6) 

0 pt2.i^[4,6) 

The function 1 (^ 3 ) = 9 'rgminpt 2 ,i{/(pi 2 ,i + ts) + g{pt 2 ,i)}, with 4 < pt 2 ,i < 6 , is determined by applying 
lemma[T] It is (see figure fl48l l 

6 t 3 < 13.5 

pt 2 ii'^ 3 ) = ^eih) with Xeits) = ■^ —^3 + 19.5 13.5 < is < 15.5 

4 t 3 > 15.5 


APi2,l(<3) 


X. 


*3 

-> 


Figure 148; Optimal processing time 1 (^ 3 )’ under the assumption ^2 = 1 in state [3 0 1 


The conditioned cost-to-go | <52 = 1) = fipt^pits) + ts) + gipf^pits)), illustrated in figure [T49l 

is provided by lemma|2] It is specified by the initial value 1.5, by the set {11, 13.5, 16, 23 } of abscissae 7 ^, 
* = 1,..., 4, at which the slope changes, and by the set { 1, 1.5, 3.5,4.5 } of slopes i = 1,..., 4, in the various 
intervals. 



Figure 149; Conditioned costs-to-go J|q | (5i = 1) and Jgg | ^2 = 1) in state [3 0 1 


In order to find the optimal cost-to-go J^q i{t 3 ), it is necessary to carry out the following minimization 

>^ 3 , 0 ,1(^3) = niin {J 3 _o,l(f 3 I <^1 = 1 ) j >^ 3 , 0 ,l (^3 I ^2 = 1 )} 

which provides, in accordance with lemma|4l the continuous, nondecreasing, piecewise linear function illustrated 
in figure [Tsoi 



The function J 3 q ^(fa) is specified by the initial value 0.5, by the set { 3, 4, 11, 13.5, 16, 23 } of abscissae 7 ^, 
* = 1,..., 6 , at which the slope changes, and by the set { 1, 0, 1, 1.5, 3.5, 4.5 } of slopes pi, i = 1,..., 6 , in the 
various intervals. 
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Since Jg q ^(^3 | (5i = 1) is the minimum in (-00,4), and \ S 2 

optimal control strategies for this state are 


5?(3,0,l,f3) = j 

' 1 f3 < 4 

0 fa > 4 

^2° (3,0,1, fa) = 


' 8 

fa < 3 


—fa + 23 

3 < fa < 4 

T°(3,0,l,f3)= < 

6 

4 < fa < 13.5 


-t3 + 19.5 

13.5 < fa < 15.5 


4 

V 

fa > 15.5 


0 t3 < 4 
1 is > 4 


The optimal control strategy r°(3, 0,1, t^) is illustrated in figure [T46l 


1) is the minimum in [4, +00, the 


Ar°( 3 , 0 ,l,t 3 ) 

-s 

-\ 


h 


Figure 151; Optimal control strategy t°(3, 0,1, ^3) in state [3 0 1 . 


Stage 2 - State [0 2 2 * 2 ]^ (S'6) 

In state [0 2 2 ^2]^, the cost function to be minimized, with respect to the (continuos) decision variable r and to 
the (binary) decision variables Si and S2 is 

(5i [ai,! max{f2 + 5^2 ,1 + t - ddi^i, 0} + /3i - t) + ■SC 2.1 + Ji,2,iih)] + 

+ S 2 [a2,3 max{f2 + sf2,2 + r - dd2,3 , + P 2 - t) + SC 2.2 + '/o,3.2(^3)] 


Case i) in which it is assumed 5i = 1 (and S 2 = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time the following function 

ai^i max{f 2 + 5^2,1 + r - ddi^i , 0 } + ,81 -''") + sc 2 ,i + Ji^ 2 ,i{h) 

that can be written as /(pfi.i + ^2) + being 


+ ^ 2 ) = 0.75 • max{p<i_i + t2 - 18.5,0} + 1 + Ji,2,i{pti,i + ^2 + 0.5) 


9{pti,i) 


8-pfi.i pfi,iG[4,8) 

0 pfi,i^[4,8) 


The function 1 (^ 2 ) = argmin^t^ i{f{pti,i + ^ 2 ) + dipti.i)}, with 4 < < 8, is determined by applying 

lemma[T] It is (see figure [T52l) 


P^l.l(^2) 


Xs{t2) h < -0.5 
Xe{t2) h > -0.5 


with Xs{t 2 ) = 


and Xe{t 2 ) 


8 -0.5 <t2< 4.5 

-t2 + 12.5 4.5 < f2 < 8.5 
4 t2> 8.5 


8 t2< -1.5 

-f2 + 6.5 -1.5<f2<-0.5 ’ 


The conditioned cost-to-go Jq 2 2(^2 | ^1 = 1) = f{pti 1(^2) + ^ 2 ) + g{pti 1(^2)), illustrated in figure [T34l is 
provided by lemma|2l It is specified by the initial value 1.5, by the set { -1.5, -0.5, 1, 4.5, 14.5, 15.5, 16.5, 18.5 } 
of abscissae 7^,1 = 1,..., 8, at which the slope changes, and by the set { 1, 0, 0.5, 1, 1.75, 2.25, 3.25, 4.25 } of 
slopes Pi, i = 1 ,..., 8, in the various intervals. 
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0 

Figure 152: Optimal processing time pt^ ^ (^2), under the assumption 


t2 

-> 


1 in state [0 2 2 ^2]^. 


Case ii) in which it is assumed ^2 = 1 (and (5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable r which corresponds to 
the processing time pt2,3, the following function 

02,3 max{f2 + st 2,2 + T - dd2,3 , 0} + /32 - t) + SC 2.2 + -^0,3,2(^3) 

that can be written as /(pf2,3 + ^2) + g{pt 2 , 3 ) being 


f{pt2,3 + h) = max{pf2,3 + f2 - 38 , 0} + Jo,3,2(F^2,3 + ^ 2 ) 


9{pt2,3) 


1.5 • (6-pf2,3) pf2,3e[4,6) 
0 pt2,3 ^ [4,6) 


The function pf2,3(^2) = argmin^j^ 3{/(pf2,3 + ^2) + gipt 2 , 3 )}, with 4 < pf2,3 < 6, is determined by applying 
lemma[T] It is (see figure flSTt 


Pt 2 , 3 it 2 ) = Xe{t 2 ) with Xe{t 2 ) 


6 t2 < 8.5 

-t 2 + 14.5 8.5 <t 2 < 10.5 
4 t2> 10.5 




\ 


t2 


Figure 153: Optimal processing time pf^ 3(^2), under the assumption ^2 = 1 in state [0 2 2 f2]^- 

The conditioned cost-to-go Jg 2 2(^2 | ^2 = 1) = f{pt 2 3(^2) + ^2) + g{pt 2 3(^2)), illustrated in figure [T54l is 
provided by lemma|3 It is specified by the initial value i, by the set { -1.5, 8.5, 10.5, 11.5, 12.5, 16.5, 34 } of 
abscissae ji, i = 1,..., 7, at which the slope changes, and by the set { 1, 1.5, 1.75, 2.25, 2.75, 3.25, 4.25 } of 
slopes Pi, i = 1 ,... ,7,in the various intervals. 



Figure 154: Conditioned costs-to-go Jg 2 2(^2 | (^i = 1) and Jg 2 2(^2 | <^2 = 1) in state [0 2 2 f2]^- 
In order to find the optimal cost-to-go Jg 2 2(^2), it is necessary to carry out the following minimization 

'^ 0 , 2 , 2 (^ 2 ) = niin I Jg 22(^2 I = 1), Jo, 2 , 2(^2 I S 2 = 1)} 

which provides, in accordance with lemmalU the continuous, nondecreasing, piecewise linear function illustrated 
in figure [155] 
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The function Jq 2 2 (^ 2 ) is specified by the initial value 1, by the set { -1.5, 0, 1, 4.5, 14.5, 15.5, 16.5, 18.5, 29.25, 
34 } of abscissae 7 ^, i = 1,..., 10, at which the slope changes, and by the set { 1, 0, 0.5, 1, 1.75, 2.25, 3.25, 4.25, 
3.25, 4.25 } of slopes /i^, i = 1,..., 10, in the various intervals. 


Since Jg 2 2(^2 I ^1 = 1) is the minimum in [ 0 , 29.25), and Jg 2 2(^2 | <^2 = 1) is the minimum in (— cxd, 0 ) and in 
[29.25, +cxd), the optimal control strategies for this state are 


<5?(0,2,2, 



0 12 < 0 
1 0 < l 2 < 29.25 
0 l 2 > 29.25 


<^2 (0,2, 2,12) 


1 l2 < 0 
0 0 < l 2 < 29.25 
1 l 2 > 29.25 


(0,2, 2, 12 ) 


6 l2 < 0 

8 0 < l 2 < 4.5 

-l 2 + 12.5 4.5 < I 2 < 8.5 

4 l 2 > 8.5 


The optimal control strategy r°(0, 2, 2, 12 ) is illustrated in figure flShl 


AT°(0,2,2,r2) 



t2 


Figure 156; Optimal control strategy t°(0, 2, 2, 12 ) in state [0 2 2 12 ]^- 


Stage 2 - State [112 * 2 ]^ (5'5) 

In state [112 12 ]^, the cost function to be minimized, with respect to the (continues) decision variable r and to 
the (binary) decision variables Si and S 2 is 

( 5 i [q!i, 2 max{l2 + sl2,i + t - ddi^2 , 0 } + / 3 i (pli°“ - f) + sc2,i + J2,i,iih)] + 

+ 62 [a2,2 max{l2 + sl2,2 + T - dd2,2 , 0} + /32 (pl^™ “ '^) + SC2.2 + -ir,2,2(^3)] 


Case i) in which it is assumed 5i = 1 (and S 2 = 0). 

In this case, it is necessary to minimize, with respect to the (continues) decision variable t which corresponds to 
the processing time pli, 2 , the following function 

q;i^ 2 max{l2 + sl2,i + t — ddi^2 , 0} + /3i (pli°“ - t) + sc2,i + J2,i,i{t3) 

that can be written as /(pli ,2 + I 2 ) + g{pti, 2 ) being 

f{ph.2 + I 2 ) = 0.5 • max{pli,2 + ^2 — 23.5 , 0} + 1 + ^2 1 i(pli,2 + ^2 + 0.5) 
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g{pti, 2 ) 


8-pii,2 pii.2e[4,8) 

0 pti,2^[4,8) 


The function 2 (^ 2 ) = SLYgmiupt^ ^{f {pti ,2 + ^ 2 ) + g{pti. 2 )}, with 4 < pti ^2 < 8, is determined by applying 
lemma[T] It is (see figure [T57l l 


Ptl.2it2) 


Xs{t2) h < —6.5 

Xi{t 2 ) —6.5 < t 2 < 2.5 with Xs{t 2 ) 
Xelh) t2 > 2.5 


8 t2< -7.5 

-t2 + 0.5 -7.5<f2<-6.5 ’ 


Xl{t 2 ) 


8 -6.5 < f2 < 0.5 

-f2 + 8.5 0.5<f2<2.5 


, and Xe{t 2 ) 


8 2.5 < f2 < 5 

—^2 T 18 5 ^ t2 ^ 9 
4 t2>9 



The conditioned cost-to-go Ji.i^ 2(^2 | ^1 = 1) = /(pfi, 2 (^ 2 ) + ^ 2 ) + g{pti, 2 {i 2 )), illustrated in figure fT59l is 
provided by lemma |2] It is specified by the initial value 1.5, by the set { -7.5, -6.5, 0.5, 2.5, 5, 12.5, 14.5, 15, 
16.16, 18.5, 19.5, 20.5 } of abscissae 7 i, i = 1,. ■., 12, at which the slope changes, and by the set { 1, 0, 1, 0.5, 1, 
1.5, 2, 3, 1.5, 2.5, 3, 4.5 } of slopes pi, i = 1,..., 12, in the various intervals. 

Case ii) in which it is assumed 62 = I (and i5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time pf 2 , 2 , the following function 


q; 2,2 max{f2 + sf2,2 + T - dd2a , 0} + ^2 (pf™™ + ^<^ 2,2 + •71,2,2(^ 3 ) 

that can be written as /(pf 2,2 + ^ 2 ) + g{pt 2 , 2 ) being 

f{pt 2,2 + t 2 ) = max{pf 2,2 + f 2 - 24 , 0} + jr, 2 , 2 (p^ 2.2 + I 2 ) 


g{pt 2 , 2 ) 


1.5 • (6 -pf2,2) 

0 


The function pf 2 2 (^ 2 ) = argmin^t^ ^ 

lemma[T] It is (see figure fTSSl) 


pt2,2 G [4, 6) 
pt2,2 i [4, 6) 

{f{pt 2,2 + ^ 2 ) + gipt 2 , 2 )}, with 4 < pf 2,2 < 6, is determined by applying 


[6 t2< 13.5 

P '^2 2 (^ 2 ) = Xe(t 2 ) with Xe{t 2 ) = < —^2 + 19.5 13.5 < ^2 < 15.5 

I 4 t2> 15.5 


4Pt2,2(t2) 


\ 


t 2 


Figure 158; Optimal processing time 2 (^ 2 ), under the assumption ^2 = 1 in state [112 f 2 ]^- 

The conditioned cost-to-go J° ^ 2(^2 | ^2 = 1) = /(pf 2 2 (^ 2 ) + ^ 2 ) + g(j>t 2 2 (^ 2 )), illustrated in figure [T59l is 
provided by lemma|2] It is specified by the initial value 1, by the set { 0.5, 2, 3, 6.5, 13.5, 16.5, 18.5, 20, 26.25, 
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Figure 159; Conditioned costs-to-go Jh 2(^2 | (^1 = 1) and J°^ 2(^2 | <^2 = 1) in state [112 12 ^- 


30 } of abscissae 7 ^, z = 1,..., 10, at which the slope changes, and by the set { 1, 0, 0.5, 1, 1.5, 2.5, 3.5, 4.5, 3.5, 
4.5 } of slopes z = 1,..., 10, in the various intervals. 

In order to find the optimal cost-to-go Jh 2 (^ 2 ), it is necessary to carry out the following minimization 

•/r.i,2(i2) = min {Jr,I^2(i2 I < 5 i = 1 ), Jr,i.2(t2 I <52 = 1 )} 

which provides, in accordance with lemma|4l the continuous, nondecreasing, piecewise linear function illustrated 
in figure [ThOl 



0 

Figure 160: Optimal cost-to-go J° ^ 2 (^ 2 ) in state [112 ^ 2 ]^- 


The function i 2 (^ 2 ) is specified by the initial value 1, by the set { 0.5, 2, 3, 6.5, 13.5, 16.5, 18.5, 20, 26.25, 30 } 
of abscissae 7 ^, z = 1,..., 10, at which the slope changes, and by the set { 1, 0, 0.5, 1, 1.5, 2.5, 3.5, 4.5, 3.5, 4.5 } 
of slopes /Zi, z = 1 ,..., 10 , in the various intervals. 

Since J^ 1 2(^2 | ^2 = 1) is always the minimum (see again figure flSOl l. the optimal control strategies for this state 
are 


5r(l,l,2,f2) =0 Vf2 <52“(l,l,2,f2) = l Vf2 

r 6 t 2 < 13.5 

T°(l,l,2,f2) = < -^2 + 19.5 13.5 <f2< 15.5 
[4 f2 > 15.5 

The optimal control strategy r°(l, 1, 2, ^ 2 ) is illustrated in figure [161] 

AT°(l.l,2,t2) 

\_ 

^2 

- 0 -^ 

Figure 161: Optimal control strategy r°(l, 1, 2, ^ 2 ) in state [112 ^ 2 ]^- 
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Stage 2-State [111 

In state [111 the cost function to be minimized, with respect to the (continuos) decision variable r and to 
the (binary) decision variables and 82 is 

( 5 i [ai,2 max{t2 + + r - ddi^2 , 0 } + (pti°™ - r) + sci,i + ^2,1.1 (^3)] + 

+ 82 [^2,2 max{t 2 + stl,2 + T — dd 2,2 , 0} + /32 (pt2°“ “''■)+ ■SCl,2 + •/r,2,2(^3)] 


Case i) in which it is assumed (5i = 1 (and 82 = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time pti, 2 , the following function 

q;i^ 2 max{f2 + sti^i + t - ddi^ , 0} + - t) + sci,i + 

that can be written as /(pfi ,2 + ^ 2 ) + g{pti, 2 ) being 

f{pti ,2 + t 2 ) = 0.5 • max{pfi ,2 + f 2 - 24, 0} + J 2 .i,i{pti ,2 + ^ 2 ) 


g{pti, 2 ) = 


8-pfi,2 pfi,2e[4,8) 

0 pfi,2^[4,8) 


The function 2 (^ 2 ) = argmin^t^ 2 {/(pti ^2 + ^ 2 ) + g{pti, 2 )}, with 4 < pti ^2 < 8 , is determined by applying 
lemma[T] It is (see figure [T62l) 


Ptl,2it2) 


Xs{t2) h < -6 

Xl(t 2 ) -6 < t 2 < 3 with Xs{t 2 ) 
Xe{t2) ^2 > 3 


8 t 2 < —7 

-t 2 + 1 -7 < f 2 < -6 ’ 


Xl{t 2 ) 


8 -6 < t2 < 1 

-f 2 + 9 1 < f 2 < 3 


, and Xe{t 2 ) 


8 3 < f 2 < 5-5 

-^2 + 13.5 5.5<f2<9.5 
4 t 2 > 9.5 



The conditioned cost-to-go J° ^ ^{t 2 | = 1) = f{ptl 2 (^ 2 ) + ^ 2 ) + g{pti 2 (^ 2 )), illustrated in figure [T64l is 

provided by lemma|2| It is specified by the initial value 0.5, by the set { -7, - 6 , 1, 3, 5.5, 13, 15, 15.5, 16.6, 19, 
20, 21 } of abscissae 7 ^, z = 1,..., 12, at which the slope changes, and by the set { 1, 0, 1, 0.5, 1, 1.5, 2, 3, 1.5, 
2.5, 3, 4.5 } of slopes pi, i = 1,..., 12, in the various intervals. 

Case ii) in which it is assumed ^2 = 1 (and i5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time pf 2 , 2 , the following function 

q; 2,2 max{f2 + sti^2 + T — dd2a , 0} + ^2 (pf™™ + sci.2 + •^ 1 , 2 , 2 fe) 

that can be written as f{pt 2.2 + ^ 2 ) + g{pt 2 , 2 ) being 


f{pt 2,2 + ^ 2 ) = max{pf 2.2 + ^2 - 23 , 0} + 0.5 + ./i° 2 , 2 (P^ 2,2 +^2 + 1) 


g{pt 2 , 2 ) 


1.5 • (6 -pf 2 . 2 ) pt2,2e[4,6) 
0 pt 2,2 ^ [4, 6 ) 
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The function ^^2 2 (^ 2 ) = argminpt 2 , 2 {/(pi 2,2 + ^ 2 ) + g{pt 2 , 2 )}, with 4 < ^^ 2,2 < 6, is determined by applying 
lemma[T] It is (see figure [163 


[6 t2< 12.5 

P ^2 2 (^ 2 ) = Xe{t 2 ) with Xe{t 2 ) = s —^2 + 18.5 12.5 < f 2 < 14.5 

[4 f2 > 14.5 

AP<2,2(<2) 

\ _ 


Figure 163; Optimal processing time 2 (^ 2 ), under the assumption ^2 = 1 in state [111 f 2 ]^- 

The conditioned cost-to-go J° ^ ^{t2 | ^2 = 1) = fipt^ 2 (^ 2 ) + ^ 2 ) + g{pt2 2 (^ 2 )), illustrated in figure [T64j is 
provided by lemma[2| It is specified by the initial value 1.5, by the set { -0.5, 1, 2, 5.5, 12.5, 15.5, 17.5, 19, 25.25, 
29 } of abscissae 7 ^, i = 1,..., 10, at which the slope changes, and by the set { 1, 0, 0.5, 1, 1.5, 2.5, 3.5, 4.5, 3.5, 
4.5 } of slopes Pi, i = 1,..., 10, in the various intervals. 



Figure 164; Conditioned costs-to-go Jh i{t 2 | (5i = 1) and J° ^ i{t 2 | (52 = 1) in state [111 f 2 ]^- 
In order to find the optimal cost-to-go Jh 1 (^ 2 ), it is necessary to carry out the following minimization 
14(^2) = niin {Ji_ij(f2 I < 5 i = 1), Jis^i{t 2 | <52 = 1)} 

which provides, in accordance with lemma[4l the continuous, nondecreasing, piecewise linear function illustrated 
in figure [T65] 



0 

Figure 165; Optimal cost-to-go J° ^ 1 (^ 2 ) in state [111 ^ 2 ]^- 


The function J° ^ i{t 2 ) is specified by the initial value 0.5, by the set { -7, - 6 , 1, 3, 5.5, 13, 15, 15.5, 17.25, 19, 
20, 21 } of abscissae 7 ^, 1 = 1,. •., 10, at which the slope changes, and by the set { 1, 0, 1, 0.5, 1, 1.5, 2, 2.5, 1.5, 
2.5, 3, 4.5 } of slopes p^, i = 1,..., 10, in the various intervals. 
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Since Ji i 1(^2 | <5i = 1) is the minimum in (— 00 , —6), in [1,15.5), and in [17.25, + 00 ), and Ji 1 i(i 2 | <^2 = 1) 
is the minimum in [—6, —1) and in [15.5,17.25), the optimal control strategies for this state are 




'1 t 2 < -6 
0 -6 < f2 < 1 
< 1 1 < t2 < 15.5 

0 15.5 <t 2 < 17.25 
1 t 2 > 17.25 


(5°(l,l,l,f2) 


'0 t 2 < -6 
1 -6 < f2 < 1 
< 0 1 < f2 < 15.5 
1 15.5 < f2 < 17.25 
0 f2 > 17.25 


r°(l,l,l,f2) 


r 8 t 2<-7 


^2 

+ 

1 

-7<t2< 

-6 




-6 <t2 < 

1 

^2 

+ 

9 

1 < f2 < 3 





3 < f2 < 5. 

,5 

^2 

+ 

13.5 

5.5 <t2< 

9.5 




t2 > 9.5 



The optimal control strategy r°(l, 1,1, ^ 2 ) is illustrated in hgure fThhl 



Figure 166: Optimal control strategy r°(l, 1,1, ^ 2 ) in state [111 ^ 2 ]^- 


Stage 2 - State [2 0 1 * 2 ]^ (S'3) 

In state [2 0 1 ^ 2 ]^, the cost function to be minimized, with respect to the (continues) decision variable r and to 
the (binary) decision variables and 82 is 

(5i[q;i, 3 max{f 2 + + r - ddi^s , 0} +/li - t) + sci,i + J3,o,i(f3)] + 

+ ^2 [<22,1 max{f2 + sfi,2 + T - dd2,i , 0} + /32 (pf™™ “ '^) + sci.2 + > 724 , 2 (^ 3 )] 


Case i) in which it is assumed = 1 (and 62 = 0). 

In this case, it is necessary to minimize, with respect to the (continues) decision variable t which corresponds to 
the processing time pfi, 3 , the following function 

q;i ,3 max{f2 + sfia + t - ddi^s , 0} + ,81 (pi?®™ - t) + sci,i + 

that can be written as /(pfi ,3 + t 2 ) + fl(pii, 3 ) being 

f{pti,3 + t2) = 1.5 • max{pfi,3 + f2 - 29 , 0} + J3,o,i(pii.3 + ^ 2 ) 


9{ph,3) 


8-pfi,3 pfi,3G[4,8) 

0 Pii.3^[4,8) 


The function pf° 3 (f 2 ) = argmin^t^ 3 {/(pfi _3 + ^ 2 ) + g{pii,3)}, with 4 < pfi _3 < 8 , is determined by applying 
lemma[T] It is (see hgure fTSTI) 




Xs{t2) t2 < -4 
Xelt2) h > -4 


with Xs{t2) 


and Xe{t2) 


8 —4 < f2 3 

-f2 + 11 3 < fa < 7 
4 f2 > 7 


8 t2 < -5 

—^2 + 3 —5 ^ ^2 < ~4 ’ 
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AK.3(<2) 



t2 


Figure 167: Optimal processing time pt^ 3 (^ 2 ), under the assumption = 1 in state [2 0 1 ^ 2 ]^- 

The conditioned cost-to-go J 2 ,o,i (^2 | ^1 = 1) = + h) + 9 {pti, 3 {t 2 )), illustrated in figure [T69l is 

provided by lemma|2] It is specified by the initial value 0.5, by the set { -5, -A, 3, 9.5, 12, 19, 25 } of abscissae 
7 i, i = 1,..., 7, at which the slope changes, and by the set { 1, 0, 1, 1.5, 3.5, 4.5, 6 } of slopes pi,i = 1,..., 7, in 
the various intervals. 

Case ii) in which it is assumed ^2 = 1 (and (5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable r which corresponds to 
the processing time pf 2 ,i, the following function 


024 max{f 2 + sfi ,2 + T - dd 2 s , 0} + /32 (pf™™ “ '^) + sci .2 + >^ 24,2 (^ 3 ) 


that can be written as f{pt 2 .i + ^ 2 ) + g{pt 2 ,i) being 


fiph,! + ^ 2 ) = 2 ■ max{pf24 + ^2 - 20 , 0} + 0.5 + ^2.i,2(P^24 +^2 + 1) 


9{pt2,i) 


1.5 ■ {6 - pt2,i) pf24€[4, 6 ) 
0 pt2,i ^ [4, 6 ) 


The function pf 2 . 1 (^ 2 ) = argmin^t^ j{/(pf 24 + ^ 2 ) + g{pt 2 ,i)}, with 4 < pt 2 p < 6 , is determined by applying 
lemma[T] It is (see figure [TfiSl l 


[6 f2 < 11 

P ^2 1 (^ 2 ) = rCe(f 2 ) with Xe{t 2 ) = < -<2 + 17 11 < <2 <13 

I 4 <2 > 13 




\ 


t2 


Figure 168: Optimal processing time p <2 1 (^ 2 ), under the assumption ^2 = 1 in state [2 0 1 < 2 ]^- 

The conditioned cost-to-go J^q i (<2 j ^2 = 1) = /(p <2 1 (^ 2 ) + < 2 ) + 5 (p <2 1 (^ 2 )), illustrated in figure [T69l is 
provided by lemma|2] It is specified by the initial value 1.5, by the set { 1.5, 3, 4, 7.5, 11, 15, 15.5, 16, 17.5, 19.16, 

19.5, 23.75, 25 } of abscissae 7 ^, i = 1,..., 13, at which the slope changes, and by the set { 1, 0, 0.5, 1, 1.5, 2, 3, 
5, 6 , 4.5, 6 , 5, 6 } of slopes pi, i = 1,..., 13, in the various intervals. 

In order to find the optimal cost-to-go +20 1 (^ 2 ), it is necessary to carry out the following minimization 

'^ 2 , 04 (^ 2 ) = min {+ 2 , 04(^2 I *^1 = 1) > • 72 , 0 , 1(^2 | ^2 = 1 )} 

which provides, in accordance with lemmalU the continuous, nondecreasing, piecewise linear function illustrated 
in figure [TTOI 

The function +29 i(< 2 ) is specified by the initial value 0.5, by the set { -5, -4, 3, 5, 7.5, 11, 15, 15.5, 16, 17.5, 
19.16, 19.5, 21.3, 25 } of abscissae 7 ^, z = 1,..., 14, at which the slope changes, and by the set { 1, 0, 1, 0.5, 1, 

1.5, 2, 3, 5, 6 , 4.5, 6 , 4.5, 6 } of slopes z = 1,..., 14, in the various intervals. 
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Figure 169; Conditioned costs-to-go J 2 q 1(^2 | (^1 = 1) and J 2 g 1(^2 | <^2 = 1) in state [2 0 1 i 2 ]^- 



Figure 170; Optimal cost-to-go 1 (^ 2 ) in state [2 0 1 12 ]^- 


Since J 2 g i(l 2 I <5i = 1) is the minimum in (— 00 , —4), in [3, 5), and in [21.3, + 00 ), and g 1(^2 | ^2 = 1) is the 
minimum in [—4,3) and in [5, 21.3), the optimal control strategies for this state are 


<5?(2,0,l,f2) 


'1 12 < -4 
0 -4 < l2 < 3 
< 1 3 < 12 < 5 _ 

0 5 < I 2 <_21.3 
1 I 2 > 21.3 


5 ° ( 2 ,0,1,12) 


'0 I 2 < -4 
1 -4 < I 2 < 3 
< 0 3 < I 2 < 5 _ 
1 5 < I 2 <_21.3 
0 I 2 > 21.3 


' 8 

I 2 < —5 

—12 + 3 

— 5<l2< — 

6 

-4 < I 2 < 3 

-I 2 + 11 

3 < I 2 < 5 

6 

5 < I 2 < 11 

-I 2 + 17 

11 < I 2 < 13 

4 

\ 

I 2 > 13 


The optimal control strategy r°(2,0,1, 12 ) is illustrated in figure [T tT] 




Ar°(2,0,l,t2) 


\ 


^2 


Figure 171; Optimal control strategy t °(2, 0,1,12) in state [2 0 1 12]^. 
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Stage 1 - State [0 1 2 (52) 

In state [0 12 ti]^, the cost function to be minimized, with respect to the (continuos) decision variable r and to 
the (binary) decision variables and 82 is 

(5i [ai,i max{ti + st 2 ,i + r - ddi,i , 0} + — t) + sc 2 ,i + A°i.i(t 2 )] + 

+ 82 [a 2,2 max{ti + St2,2 + T - 882,2 , 0} + /32 (^^ 2 °“ ■SC2,2 + •/o,2,2(^2)] 


Case i) in which it is assumed (5i = 1 (and 82 = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time the following function 


ai,i max{fi + st2,i + t - ddi,i , 0} + - t) + sc 2 ,i + Ji,i,i{t2) 

that can be written as f{pti,i + ti) + g{pti,i) being 


f{pti,i + ti) = 0.75 • max{pfi4 + f 1 - 18.5,0} + 1 + Ji,i,i{pti,i +ti + 0.5) 


g{pti,i) = 


8 -pti,i pfi4e[4,8) 

0 pfi,i^[4,8) 


The function = argmin^t^ + ti) + g{pti,i)}, with 4 < pti,i < 8, is determined by applying 

lemma[T] It is (see figure fT72l) 


Ptliih) 


Xs{ti) ti < —14.5 

ari(ti) —14.5 < fi < —5.5 with a;s(ii) 
Xe{tl) ti > —5.5 


8 ti< -15.5 

-fi-7.5 -15.5 < fi <-14.5 ’ 


Xl{ti) 


8 -14.5 < fi < -7.5 

-fi + 0.5 -7.5<fi<-5.5 


, and a;e(fi) 


8 -5.5 < fi < -3 

—ti T 5 —3 ^ ^ 1 

4 fi > 1 



The conditioned cost-to-go Jq ^ 2(^1 I ^1 = 1) = fipti i(fi) + fi) + g{pti illustrated in figure fT74l is 

provided by lemma |2] It is specified by the initial value 1.5, by the set {-15.5,-14.5,-7.5,-5.5,-3, 8.5, 10.5, 11, 
12.75, 14.5, 15.5, 16.5 } of abscissae ji, i = 1,..., 12, at which the slope changes, and by the set { 1, 0, 1, 0.5, 1, 
1.5, 2, 2.5, 1.5, 3.25, 3.75, 5.25 } of slopes pi, i = 1,..., 12, in the various intervals. 

Case ii) in which it is assumed ^2 = 1 (and (5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable r which corresponds to 
the processing time pt 2 , 2 , the following function 


02,2 maxjfi + st2,2 + T - 882,2 , 0 } + /32 (pt2°™ - t) + SC2,2 + </o.2,2(^2) 
that can be written as f{pt2,2 + fi) + g{pt2,2) being 

f{pt2,2 + h) = max{pf2,2 + - 24,0} + Jo,2.2b^2.2 + h) 


, , J 1.5-(6-pf2,2) pf2.2e[4,6) 

= 1 0 Pf2.2^[4,6) 


Davide GIgllo 


DIBRIS - University of Genova 


96 











Fundamental lemmas for the determination of optimal control strategies 
for a class of single machine family scheduling problems 


The function ^^2 2 (^ 1 ) = argminpt 2 , 2 {/(pi 2,2 + ^i) + g{pt 2 , 2 )}, with 4 < pf 2,2 < 6, is determined by applying 
lemma[T] It is (see figure [TT^ 


[6 h < 8.5 

P ^2 2 (^ 1 ) = 2;e(fi) with a;e(fi) = < —h + 14.5 8.5 < < 10.5 

I 4 ti> 10.5 


A'pt^^ih) 


\ 


h 


Figure 173; Optimal processing time 2 (^ 1 )’ under the assumption ^2 = 1 in state [0 12 fi]^. 

The conditioned cost-to-go J§ ^ 2(^1 I ^2 = 1) = f{pt 2 2 (^ 1 ) + ^ 1 ) + 9 ipt 2 2 (^ 1 ))’ illustrated in figure [T74l is 
provided by lemma|2] It is specified by the initial value 1, by the set { -7.5, -6, -5, -1.5, 8.5, 10.5, 11.5, 12.5, 
14.5, 20, 25.25, 30 } of abscissae 7 ^, z = 1,..., 12, at which the slope changes, and by the set { 1, 0, 0.5, 1, 1.5, 
1.75, 2.25, 3.25, 4.25, 5.25, 4.25, 5.25 } of slopes z = 1,..., 12, in the various intervals. 



Figure 174; Conditioned costs-to-go Jq i 2(^1 | (5i = 1) and Jq ^ 2(^1 I <^2 = 1) in state [0 12 
In order to find the optimal cost-to-go Jg ^ 2 (^ 1 )’ it is necessary to carry out the following minimization 

'^,l,2(^l) = niin {Jo_i^2(^i I <^1 = 1 ) j >^a,2(t^l I <^2 = 1 )} 

which provides, in accordance with lemma|4l the continuous, nondecreasing, piecewise linear function illustrated 
in figure [T 75 ] 



The function Jg ^ 2 (^ 1 ) is specified by the initial value 1, by the set { -7.5, - 6 , -5, -1.5, 8.5, 10.5, 11.5, 12.5, 14.5, 
15, 15.5, 16.5, 17.5, 20, 25.25, 30 } of abscissae 7 ^, z = 1,..., 16, at which the slope changes, and by the set { 1, 
0, 0.5, 1, 1.5, 1.75, 2.25, 3.25, 4.25, 3.25, 3.75, 5.25, 4.25, 5.25, 4.25, 5.25 } of slopes i = 1,..., 16, in the 
various intervals. 
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Since Jg ^ 2(^1 I <^1 = 1) is the minimum in [15,17.5), and Jg ^ 2(^1 I <^2 = 1) is the minimum in (— cxd, 15) and in 
[17.5, + 00 ), the optimal control strategies for this state are 


<5?(0,l,2,fi) = 


0 < 15 

1 15 < < 17.5 

0 > 17.5 


5“(0,l,2,fi) 


1 < 15 

0 15 < < 17.5 

1 h > 17.5 


[6 ti < 8.5 

T°(0, l,2,fi) = <^ -<1 + 14.5 8.5 <<i< 10.5 
I 4 <1 > 10.5 


The optimal control strategy r°(0,1, 2, <i) is illustrated in hgure[T76] 


A+(0,1,2,+) 


\ 




Figure 176: Optimal control strategy t°(0, 1, 2, <i) in state [0 12 <i]^. 


Stage 1 - State [10 1 fi]^ (S'!) 

In state [10 1 <i]^, the cost function to be minimized, with respect to the (continuos) decision variable r and to 
the (binary) decision variables Si and <52 is 

(5i [q!i ,2 max{<i + sfij + r - ddi ^2 , 0} + /3i - t) + sci,i + J 2 .o,i(^ 2 )] + 

+ ^2 [< 22,1 max{<i + Sti^2 + T - dd 24 > 0} + /32 (P<2°“ - t) + SCi,2 + Jl.l,2it2)] 


Case i) in which it is assumed 5i = 1 (and S 2 = 0 ). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time p<i, 2 , the following function 

0:1^2 max{<i + sti^i + T — ddi ^2 , 0 } + ,81 - i") + sci,! + >^2,0,1 (^2) 

that can be written as /(p<i ,2 + ^i) + g{pti, 2 ) being 

f{pti ,2 + tl) = 0.5 • max{p<i,2 + <i - 24 , 0 } + J2,o,i(f*i.2 + h) 


g{pti,2) 


8-p<i,2 p<i.2e[4,8) 

0 p<i,2^[4,8) 


The function p<i 2 (^ 1 ) = argmin^t^ 2 {/(f^i ,2 + ^i) + g{pti. 2 )}, with 4 < p<i ,2 < 8, is determined by applying 
lemma[T] It is (see hgure fTT?]) 


ptiAh) 


Xs{ti) tl < -12 

a;i(<i) —12 < <1 < —3 with 

Xelh) tl > -3 


r 8 ti< -13 

\ -<i -5 -13 <ti< -12 ’ 


a:i(<i) 


8 -12<<i<-5 

—tl + 3 —5 < <1 < —3 


, and a;e(<i) 


8 -3 < <1 < -0.5 

-ti + 7.5 -0.5<<i<3.5 
4 <1 > 3.5 


The conditioned cost-to-go J°g ^(<1 | = 1) = fipti 2 (^ 1 ) + f^i) + g{pti 2 (^ 1 ))^ illustrated in figure [T79l is 

provided by lemma|2| It is specified by the initial value 6 . 5 , by the set { -13, -12, -5, -3, -0.5, 7, 11, 11.5, 12, 
13.5, 15.16, 15.5, 17.3, 20, 21 } of abscissae ji, i = 1,..., 15, at which the slope changes, and by the set { 1, 0, 1, 
0.5, 1, 1.5, 2, 3, 5, 6, 4.5, 6, 4.5, 5, 6.5 } of slopes fii, i = 1,..., 15, in the various intervals. 
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Case ii) in which it is assumed ^2 = 1 (and (5i = 0). 

In this case, it is necessary to minimize, with respect to the (continues) decision variable r which corresponds to 
the processing time pf: 2 ,i, the following function 

a 24 max{fi + sti ^2 + r - dd 2 ^i , 0} + /32 + sci ,2 + •/“a, 2 (^ 2 ) 

that can be written as /(pf 2 ,i + fi) + g{pt 2 ,i) being 


fiph,! + ti) = 2 - max{pf2,i + fi - 20 , 0} + 0.5 + Ji,i,2{pt2,i + + 1) 


9{pi2,i) 


1.5 • (6 -pf2.i) 

0 


The function pf 2 1 (^ 1 ) = argmin^t^ ^ 
lemma[T] It is (see figure fTTSl l 


pt2,i e [4,6) 
pt2,i i [4,6) 

{/(pi2.i + h) + g{pt2,i)}, with 4 < pt2,i < 6, is determined by applying 


= Xe{tl) with Xe(fl) 


6 h < 6.5 

-fi + 12.5 6.5<fi<8.5 
4 ti> 8.5 




\ 




Figure 178; Optimal processing time pf^ i(fi), under the assumption ^2 = 1 in state [10 1 fi]^. 

The conditioned cost-to-go J°q i{ti j ^2 = 1 ) = /(pf 2 1 (^ 1 ) + ^ 1 ) + 9 {pt 2 1 (^ 1 ))’ illustrated in figure [T79l is 
provided by lemma|2] It is specified by the initial value 1.5, by the set { -6.5, -5, -4, -0.5, 6.5, 11.5, 13.5, 15, 16, 
21.25, 25 } of abscissae ji, i = 1,. •., 11, at which the slope changes, and by the set { 1, 0, 0.5, 1, 1.5, 2.5, 3.5, 
4.5, 6.5, 5.5, 6.5 } of slopes pi, i = 1,..., 11, in the various intervals. 



Figure 179; Conditioned costs-to-go J^q i{ti | (5i = 1) and J°g | <52 = 1) in state [10 1 fi]^. 
In order to find the optimal cost-to-go J^q i(fi), it is necessary to carry out the following minimization 


= min {Jr,o.i(ii I < 5 i = 1 ), \ 82 = 1 )} 

which provides, in accordance with lemmalU the continuous, nondecreasing, piecewise linear function illustrated 
in figure llSOl 
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0 

Figure 180; Optimal cost-to-go J°q ^(ii) in state [10 1 ii]^. 


The function J°q ^(fi) is specified by the initial value 0.5, by the set { -13, -12, -5, -3, -0.5, 7, 11, 11.5, 13.5, 
15, 16, 21.25, 25 } of abscissae 7 ^, z = 1,..., 13, at which the slope changes, and by the set { 1, 0, 1, 0.5, 1, 1.5, 
2, 2.5, 3.5, 4.5, 6.5, 5.5, 6.5 } of slopes /i^, z = 1,..., 13, in the various intervals. 

Since J°g ^(fi | = 1) is the minimum in (— 00 ,12) and in [—5,11.5), and J^q | ^2 = 1) is the minimum 

in [—12, —5) and in [11.5, + 00 ), the optimal control strategies for this state are 


ti < -12 

-12 < ti < -5 
-5 < < 11.5 

h > 11.5 


' 8 

h < -13 

-h - 5 

-13 < fi < -12 

6 

-12 < fi < -5 

—ti + 3 

—5 < fi < —3 

8 

-3 < fi < -0.5 

-fi + 7.5 

-0.5 < ii < 3.5 

4 

\ 

h > 3.5 


The optimal control strategy r°(l, 0,1, ti) is illustrated in figure [TSTl 


<5?(l,0,l,fi) = 


1 h < -12 
0 -12 < fi < -5 
1 -5<fi<11.5 
0 > 11.5 


J2“(l,0,l,fi) = 



Figure 181: Optimal control strategy t°( 1, 0,1, fi) in state [10 1 fi]^. 


Stage 0 - State [0 0 0 fo]^ (S'O) 

In the initial state [0 0 0 the cost function to be minimized, with respect to the (continuos) decision variable 
r and to the (binary) decision variables and ^2 is 

( 5 i[q!i,i max{fo + sfo.i + t - ddi^i , 0} +/ 3 i - t) + scq.i + 07(^1)] + 

+ S2 [a2,i max{fo + sfo.2 + t - dd2,i , 0 } + /32 (pf™™ - t) + sco.2 + >^o.i,2(^i)] 

Case i) in which it is assumed = 1 (and 62 = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time pfi^i, the following function 

0:17 maxjfo + sfo,i + r - ddi^i , 0} + / 3 i (pf"”™ - t) + SC07 + 
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that can be written as /(pii.i + to) + being 


+ to) = 0.75 • inax{p<i,i + to - 19 , 0} + + ^o) 


g{pti,i) 


8-pti^i pti,ie[4,8) 
0 


The function j(to) = argminptj ^{/(pti^i + to) + g{pti^i)}, with 4 < pti^i < 8, is determined by applying 
lemma[T] It is (see figure [T82]i 


Pti.ii^o) 


Xs{to) to < -20 

a^i(fo) —20 < to < —11 with Xs{to) 
Xe(to) to > -11 


8 ^0 ^ —21 

-to - 13 -21 < to < -20 ’ 


Xi(to) 


8 -20 < to < -13 

-to-5 -13 < to <-11 


, and are(to) 


8 -11 < to < -8.5 

-to-0.5 -8.5 < to <-4.5 
4 to > -4.5 



Figure 182: Optimal processing time ptj ^ (to), under the assumption (5i = 1 in the initial state [0 0 0 to]^. 


The conditioned cost-to-go Jg o o(^o | = 1) = f{pti i(to) + to) + p(pt° j(to)), illustrated in figure [T84l is 

provided by lemma|2] It is specified by the initial value 0.5, by the set { -21, -20, -13, -11, -8.5, 3, 7, 7.5, 9.5, 
11, 12, 15, 17.25, 21 } of abscissae 7 ^, t = 1,..., 14, at which the slope changes, and by the set { 1,0, 1, 0.5, 1, 
1.5, 2, 2.5, 3.5, 4.5, 6.5, 7.25, 6.25, 7.25 } of slopes pi, i = 1,..., 14, in the various intervals. 

Case ii) in which it is assumed ^2 = 1 (and (5i = 0). 

In this case, it is necessary to minimize, with respect to the (continuos) decision variable t which corresponds to 
the processing time pt 2 ,i, the following function 

0:2,1 max{fo + sio,2 + t - dd2,i , 0 } + /32 (pf™™ “ '^) + ■sco,2 + •/o,i,2(^i) 

that can be written as f{pt 2 .i + fo) + g{pt 2 ,i) being 


f(pt 2 ,i +to)=2- max{pf 2 ,i + to - 21, 0} + Jo,i. 2 {pt 2 ,i + to) 


g{pt2,i) 


1.5 • (6-pt2,i) pt2,ie[4,6) 

0 pt2,i^[4,6) 


The function pt 2 ;^(to) = argminpt 2 ,i{/(pt 2 ,i + to) + 5 (pt 2 ,i)}, with 4 < pt 2 ,i < 6, is determined by applying 
lemma[T] It is (see figure [T83t 

[6 to < 2.5 

pt 2 i{to) = Xe{to) with a:e(to) = < —to + 8.5 2.5 < to < 4.5 

I 4 to > 4.5 


The conditioned cost-to-go Jqq 0(^0 | ^2 = 1) = /(pt^ i(to) + to) + g(j>t 2 i(to)), illustrated in figure [T84l is 
provided by lemma|2 It is specified by the initial value 1, by the set { -13.5, -12, -11, -7.5, 2.5, 6.5, 7.5, 8.5, 10.5, 
11, 11.5, 12.5, 13.5, 16, 17, 21.25, 26 } of abscissae 7 ^, i = 1,..., 17, at which the slope changes, and by the set 
{ 1,0, 0.5, 1, 1.5, 1.75,2.25,3.25,4.25,3.25, 3.75,5.25,4.25,5.25,7.25,6.25,7.25 } of slopes = 1,...,17, 
in the various intervals. 

In order to find the optimal cost-to-go Jg 0 0 (^ 0 )^ it is necessary to carry out the following minimization 
'^,o,o(^o) = ™-in| jQ Q g(to I (5i = 1 ), Jopfi{to | ^2 = 1 )} 
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APi2,i(to) 


to 


Figure 183: Optimal processing time pt^ i {to), under the assumption ^2 = 1 in the initial state [0 0 0 to]^- 



Figure 184: Conditioned costs-to-go Jq g o(^o I <^i = 1) Jq g g(tg | (52 = 1) in the initial state [0 0 0 to]'^- 



0 

Figure 185: Optimal cost-to-go Jg g g(io) in the initial state [0 0 0 to]'^. 


which provides, in accordance with lemma|4l the continuous, nondecreasing, piecewise linear function illustrated 
in figure [185] 

The function Jg g g(fo) is specified by the initial value 0.5, by the set { -21, -20.5, -13.5, -12, -11, -7.5, 2.5, 6.5, 
7.5, 8.5, 10.5, 11, 11.5, 12.5, 13.5, 16, 17, 21.25, 26 } of abscissae ji, i = 1, •. •, 19, at which the slope changes, 
and by the set { 1,0, 1,0, 0.5, 1, 1.5, 1.75, 2.25, 3.25,4.25, 3.25, 3.75, 5.25, 4.25, 5.25, 7.25, 6.25, 7.25 } of slopes 
Pi, i = 1,..., 19, in the various intervals. 

Since jQgg(fg | = 1) is the minimum in (—cx),—20.5), and Jgg g(fg | S 2 = 1) is the minimum in [—20.5,+00) 

(see again figure [T84||, the optimal control strategies for the initial state are 


<5?(0,0,0,fo) 


1 to < -20.5 
0 to > -20.5 


suo,o,o,to) 


0 to < -20.5 
1 to > -20.5 


T°(0,0,0,fg)= 


-to - 13 
6 

—to + 8.5 
4 


to < —21 
-21 <to< -20.5 
-20.5 <to < 2.5 
2.5 <to < 4.5 
to > 4.5 


The optimal control strategy r°(0, 0,0, to) is illustrated in figure [T86l 
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AT°(o,o,o,ro) 


to 


Figure 186: Optimal control strategy t°(0, 0,0, to) in the initial state [0 0 0 to]^- 
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